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• PREFACE FROM 



TO STUDY (.GUIDE REVIEWERS : 



m\aas 



The test editions of the initial set of eight Study Guides were prepared on 
relatively short notice by the course directors during the summer o? 1974- To 

■ ' ■ ■ \ ' i ' 

provide as much information as possible to the authors for use in revising this 

^ - " ' * ^ - . -■ 

study guide -^f or publication , we ask you as a participant in the NSF Chautauqua-Type : 

' ■ A 

Short Course, or a colleague or student of a participant, to test these materials > 
(as if they had been published) and\provide your reactions. Your efforts will con— 



t^^utdi significantly to the quality of the revised Study Guide. 

If this Study Guide has been successfully prepared, upon- completing it, yOu 



will: (i) yhave an overall comprehension of the scope of the problem, (ii) imder— 
stand the relationships between aspects of the problem and their in^lications for 
human welfare, and (iii) possess a reliable guide for studying one or more aspects 
of th^. problem in greater depth. ^ We ask you to evaluate the study guide on the 
basis of . how well each of these objectives are achieved. Of less importance but- 
most welcome are your specific edjLtorial suggestions, including punctuation, syntax, 
vocabulary^ accuracy of references, effectiveness of illustrations, usefulness and/ 
organization of 'tabular materials, and other aspects of the draft tha^ are related 
to its function. Three copies of an evaluation form follow this page and additional 
copies may be reproduced if needed. Each evaT/xator should return a completed form ^ 
to: NSF Chautauqua-Type Short Course Progr^, 1776 Massachuspt.ts Avenue, NW, 
Wcishington, D.C. 20036. .^.Pleasif^ype or print legibly.' Feel free to include any 
additional co^^ts you care to make* This evaluation is in addition to any evaluate 
requests made by the stxidy guide authors; however, we do encourage you to cooperate^ 
with all requests from authors. 
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We hope that having used this guide will provide some remuneration to you 
^d that if you were able to participate in the sessions of the Short Course, you 
,gained satisfaction from that- Your efforts in evaluating this study guide are 
a worthwhile contribution toy the improvement of undergraduate education and we 
express our appreciation to you- Apart from this, we can only^bffer to include 
-your -name among the evaluatorS in tlie revised^ edition . - ^ 

^We hereby gratefully acknowledge the services of Joan G. Creager, Consulting 



Editor, and Or in McCarley, Production Manager for this series. 



Arthur H. Livermore 
Deputy Director of Education 
AAAS I 



Howard F. Fon cannon 

Associate Director' of Education 

AAAS 
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_ - AAAS ICVAl.U.VJ'ION VOlOi 

■■ -X ■ 

Aftc^r comp.l ctinf; thi^': r-Ludy f;utcic, lent' cut one copy of thir: iibcct, coii>p]ctc 
it, fold, a'nd i:iail. No envelope, js needed.* 

Circle the roijponsc^ thnL. hur-t i:iat;chci; your f celiac about* the sludy guide. Alro, 
please make .'ipccific s\^ll'^ilr^\:±OY\'^^ v;h^-cver po:;sible» 



1, Did Vou achieve an overaI3.v_COTr,pr<.«-Iic;nt;ion of the scope, 
of the proSlcn:? ^ 

Suggestions for linprovciiK-.nt ; | 

- --^ - 

2. Did you acliieve an understanding of relationships 
between aspects of the problem and their ircplicatibns iot 
human welfare? 

Suggestions ^^r improv^jment : ^ 



3. Ts this a roliable guide for studying one or more 
aspects of the problem in z'i:o^€iter djcpth? 
Suggestions for improvenient : ^ 

4. Wa s th ,e content of this' study guide 'clearly present)!^? 
Please coimr.ent on specific pagers and paragraphs, if 
appropriate. ^. Use the back ^)f this page end additional 
nag.cs if necessary • Pleas^type or print clearly. 



Un^i!%is- 

factory 



Satis- 
factory 



1 



5. Did you find the study guide infprmative? 
Please coinraent as specifically as possible. 



'2 



5C 



6. Are there any topics iitj this ^txidy guide that you think should have been 
modified? - . . any- that should have been added?.. . . deleted? 



7. Rate the study guide as a whole for the following situations: 

independent study by college teachers ^ 12 3 4 

independent study' by college students - 1-234 

a .basic text for a conventional course 1,234 
a supplement in a conventional course ' 12 3 4 

other: 



5 
5 
5 



PLEASE DO NOT \sT^ITE IN THIS' 

.A 

SPACE 



->-< 



I 8. VJhnt was your background in Lhc subject, before uclnr. thiy slndy Ruidc*? 
( ) none or lit Me ( ) col.l.cf,c courses ( ) tcachin}; the J::ubjccl 
( ) oLber: 

9. Your present pociclcn is: ( ) colleec teacher. ( ) college student 
( ) ocher: 

10. Wiat specific changes are needed to make this study' guide more useful to 
colljpge students? 



11. Please make any other comments you feel would bo helpfitl (regarding 
illustrations, tables, accuracy and availability of references, extent to which 
objectives were met). 



Please fill in your name and institutional address below, fold, staple, and mail 
Thank you for your assistance.^ 



9C002 'D 'a *vion3uxv[SVt\ 
*W *N *3nu3AV sqaos.nqoBsscK 9 LIT 
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PREFACE FROM THE AUTHORS » 

^ The Rreface From The AAAS^ whicffh iinmediately precedes this preface, contains 
e general evaluation form applicable ^o all study guides. That preface also asks 
you to complete and return the evaluation to the AAAS offices; The authors urge 
you to do so at your earliest convenience • The responses to those questions will be 
of immeasurable value in revising this study guide. 

In addition the authors have prepared some evaluation forms designed specifically 
for this particular study guide _on Mathematical Modeling and Computing. A rather 
broad evaluation form which cover^^he Entire manuscript * :5 at the close of 
this preface. In addition there are; chapter evaluation forms at the end of each 
cliapter. We would appreciate your completing and returning as many of these forms 
as you feel are appropriate- They Have purposely been kept brief in ordej^^-^t 
make an unduly large demand on your^ time- If you wish to make any other comments 
or criticisms, be assured that they will be taken seriously when the rewriting 
process begins, ^ 

Please send -all o& your responses (excWpt fdr the evaliiation form in the 
preceding preface) directly to: - . ' 

Professors Jack K* Cohen and William S. Dom 
Department of Mathematics , 
University of Denver 

Denver, Colora4o 80210 / ' 

You may wish tjo remain ancinymous , and the authors respect your right to do so. 



Our sincere thanks for ycyr assistance and cooperation in thif> difficult 

5 < 



:ask- 

Jack K- Cohen 
William S- Dom 
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STUDY GUIDE EVALUATION 

1. Did you participate in a short course in 1974-7.5? Yes No 

2. Which one or two chapters were the most interesting? _^ 



3-. Which one or two chapters were the most useful to you in your teaching? 



4. Which one or two chapters were the easiest to read and understand? 



5. In general were the descriptions^too detailed? ^ . Yes ' No 

6. Should there have been more space devoted to ^ . . 

(a) Modeling , ' ' Yes No 

^ ^ Cb) Mathematical Analysis ' Yes No 

/\ (c) Computer programmiTjg • ^ Yes No 

7. Is the level of 'mathematical difficulty , ■ - 

(a) Too high? Yes No 

(b) Too low? . . Yes No 

(c) About fight? ^ ' ^ Yes No 

8. .What general suggestions do you have for improving the study guides? 
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. CHAPTER I - i . 
POPTJLATiON MOD^ ^ 

:STIC Am DISCKETE MODEL 



/ TvD. Simple Models , ./ \ ' -n^ * ' ^ ^Jc^' 

Coteidei' a' sliigle ^^^^^s' life'in a closed 'environment. Aissume- that" the 
"pgpulation of this species caii ^^^^^^^^ at vairiotis points in tii^* Fpir example, 

- • " * . < - ^ " ■ ■ ; • ' 

'the population of United Stat^^s is coxmted 'every ten years through -census • 

<■ ' - , ' . ■ 

We will -call the time between c^^t^i^tings-^a ip^viod. ^ 

Lef Nj^ 'be the nuinber'of ^^^"^^^^^ alive ati the end o£ the ^th . petiod for' 
k:= 0, 1,.2, / . The beginni^S of the (k + l)st period coincides with t^ie end . 
*of the ' kth period so that ^ic population at the beginning b-f the* (k l- l)st 

period. We assume throughout- ^^^^ change in population,' N]^^.^ ^k 

during ^the (k + l)st period depends only upon N, . We ask the reader tq- ^uspeifd 
Judgment 'on the validity. thi^ assumption unti^f^rt II of these notes, where^it . 
will be critically examii^^d. - ' ' / 

'Assume now that the^^^jjiber births (deaths) in any period is proportional to 
the population at the ^^^.^ of period. The increase in population is the excess, 
of births over: deaths which may* course, be ^negative. Suppose the increase in 




y in the (k + l)st period is ^ ^ 

Exit this increase is also given 

• ■ ■ - \ 



8-1 '2 



so 



where rpr^now we assume that 



. A > 0 



^ . Given an initial '^pxilation" Ng we can calctilate Nj , N2,*. .. A program 



in BASIC to "(io so is ^ 




100 , PRIIit "TYPE 9ALUE FOR .'A* 
c__800 IMPUT A - > 
. IteK) PRINT "TYPE INITIAL POPULATION" 

400\ INPUT N 

500\PR1NT "TYiPE NO. OF FUTURE PREDICTIONS' 

^ 600 V^'*PUT ^ 

700 ;i^R«NT -» ' 

goo/ P;^I NT "PER I OD" » rPOPULAT I ON" 
90© j^OR , I - X TO M 
lOl^^r/ PRINT I*N 
HOfK LET N - <1 ♦ A)*N 
19^ NEXT I g 



SELF-STUDY; PROBLEM #1.1 

Run the above program with the values A =- .5 - Nq = 1000 . Choose values 
for A arid Nq and re-run the program. Select the additional values in a way 
which will enable you to make a conjecture about the nature of the solution to this 

- ' * A ^ ' ' 

model. Try to prove, ,by analytical means, that your conjecture is correct. 



o . - ■ ■ 
ERIC . 



^esul^^^.^f running" the program vith A » .5 'tod Nq = 1000 are 



ow. 



A- 



Tt^ WILtJK FOR A 
TYPE IWITIAL PCPULATKM 

riooo 

TYPE NO. OF FUTURE PREDICTI.ONS 

" ■ ■-725 

PERIOD POPULATION 

I 1000 

5 1500 / 

3 ' £250 

4 3375 
^5 5062.5 ' . 

6 7593.75 

7 ' 11390.63 

8 17085.94 
^ . 9 25628.91 -^^^ 

10 38443.36 

• 11 r. 57665«04 

f 12 , 66497.56 * 

13 . 129746.3 

14 > 194619.5 

15 291929.3 

16 437893.9 

17 656840.8 

18 985261.3 

19 1477892. y 
.20 2216838. 

21 3325257. 

. ,32 4987885 

» - ^ 23 7481tI28 

84 11222741 

•9 16834118 

The correct <^oujecture is that (1) for~ A > 0 the population grows in 

unboitc^jjgjj (geometr:5,c) way. (2) For A = 0 ^ the population ddes not change 
^t: all- ~1 < A < 0 , the population gradually becomes extinct. 

(4) A < » population immediately becomes extinct.. Since N^^ is 



Intrinsi'cally positive, we shall liiterpret the first negative value^ of Nj^ 
as indicating extinction* • , " , , 

The first three conjectures can be es^tablished by msing induction to 
demonstrate that " - ^ 

; \ ^ ' Nj^ = .No(l + A)^ 

^ ■ *. 

(see also Section 1.2 of the appendix) and observing that, while 

J 
/ 















for' 


"a > 0 


(1 + A )^ ' ^ ^ - .. ^ 




for 


A = 0 


• ^ ■ i 
_ .4 ' • • 1 


0 


for 


-1 ^< A < 0 



The last conjecture, * (A) i -may be verified by direct substitution into (1*1) 



, . ^ ^ ^ r 8-1.5 

. We now turn to a discussion- of the appropri^eness of this model, i.e., does ^ 

it bear any reseniblance to reality? * ^ 

For the values A = .5 and Nq = 1000 , this model <1.1) predicts that 'the 

population will grow in an unbounded way., While this may be satisfactory in the 

short term, it is not acceptable as a Ipng term- solution since eventually the 

individuals in the population will occupy all of the available space. One pey^ible 

. solution. to this dilemma is to choose A < 0 . In this , case the population either 'j 

• ^ ' *>.; . . . ' ■ ■ ■ . 

does" not c^rdnge orl^becomes extinct. * . 

'A' 'better' solution is_ to discard the assumption that the change in .population 

] ■ ' " . ' ' ' 

is some fixed percentage of • the current population. As 'lof^ as there is ample 

~^ ' ■ ■ - - , / - 

room to place newly bom individuals, ;then ,the assumption we have made may be quite 
■ all right. When the jr^^l^tion becomes large, however, theri^the individuals consume 
all of th6 fop^i supply, pollute the environment and in other ways^'make it difficult 
to maintain life. ^Thg result of this overcrowding is to reduce the birth rate and. 
iilcrease the death rate. Both of these rate changes will* decrease A • From this 
argument it follows, rather than being a constant, that A should depend upon the 
population itself. The simplest way to achieve such a dependence is to replace' 'A 
.by 




where A > 0 and B > 0 . If w£ do so'- then* A will represent the growth rate per 
person which would exist in the absence of over-population pressures, while the term ^. 
BlJ!|^ crudely models the effect of such pressures. Equation (1.1) is, replaced by 

(1.2) ^ . N^^^ - = (A - BN^) ■ ■ : 

or • , ■• ■ _ i . ^ _ ^ . 

A program which reads A , B and Nq ,^,the initial population, and computes 

• •., ' ■ 

ERIC -17 



Hi , N2 ^ ^ • • is 



too pnim 



800 IMPUT ff^ 

300 PRINT -TYPE VALUE FOB B* / . ^ 
400 IMPUT B 

500. PRINT "TYPE INITIAL POPULATlOil 
600 INPUT N V 

70a PRINT **TYPE NO* OF PREDICTIONS 
800 INPUT M 

900 PRINT * 
1000 PRINT ••PERIO0»***POPULATIOir* 
1100 FOR I • O TO N - 
1200 PRINT I#N ^ 
1300 LET N « (1 ♦A - B«N>«« 
1400 ' NEXT I 
IMO MWD : 



TTPE^VALUB FOR A 

?-5 , 

TYPE VALUE FOR B 
?«0001 / 

TYPE ^ITIAL POPULATION . 
?1000 




TYPE NO. OF PREDICTIONS 

?85 



PERIOD 



POPULATION 



O 
1 
2 
3 
4 

's 

6 

7 

8 

9 

10 

11 

18 

13 

14 

15 



lOOO 
1400 
1904- 




3705*223 
4184.967 
4526*056 
4740*565 
4863-552 
4929.914 
,4964*466 
4982*107 
4991*021 
4995 *S03 
4997*749 



8T.1.7 



i7 

18 
19 
20 
21 
2& 
23 
24 



49ft9*437 
4999.7ie 
4999ii8S9 
4999*93 
4999*965 
4999*982 
4999*991 
49^ •fM 
4^M*M8 
\^ ■ 



Notice that the poptilation grows rapidly at first but ^hen taper;^ off and seems to be 
approaching 5000. We will return tb 'a discussion of .the behavior of this solution in 



Section- 1.3. 



f study: Problem #1.2 



It turns out that our second model, (1.2)% has a much wider variety o'f solution 
t3rpes than the first model, (1.1). In this problejn,twe ask you to 'explore there- 
behavior's and make conjectures about the conditions on A , B and Nq which produces 
these behaviors. To do this> use equation (1.2) to derive formulas for A and B 
given' Nq^, , N2* Theii use the'-foi^ulas which you have derived to compute A and ^ 
B far the- ^0 » Ni values given. Below. Next use these v-alues cLn the program above ^ 
to 'compute the population for^ 25' time periods. You may find it convenient to combine 
- these steps by suitably modifying the* given prog^ram, * -j- \ 

jConsidfer the cases .in which Nq , , N2 are given by 





No 




. N2 




(a) 


1000 


'1400 , 


1900 




(b) . 


1000 


■ 2400 


5500 




(c) 


1000 


- 4900 _ 


22100 




(d) 


1000 


2900 


7900 


> 


(e) 


1000 


-. ■ 2900 , . 


7800 
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N2 


(f) ' 


1000 ■ 


:39po 


/ 14000 


(8) 


: 1000 


3900 


14100 






- ^ / 





Nbtiixg tllat Nq ^ were essentually fixed j!^the above cases, vary A and^ 

re-fun the program xjntil you ca^^sBake suitable conjectures about the behavior of 
the solution for Nq and B fixed. Next systematically vary B to see if *yo4ir 
conclu3ions are affected. Finally-, vary Nq • ^/ 



8-1, 



Soluiton to Self-Study: Problem it ^ 

5' 



The solutions for A and B are 



and 



No Ni (Ni - No) 



B = 



Ni^ - Nn N? 
No Ni (Ni - No)" 



For the specific values given for Nq, N^, N2> we have: 



(a) A = .507,' B = 1.07 x 10"^ , solution approaches 4738.3 in a 
monotone manner. ' \ . ^ 

(b) A = 1.477, B = ,.77 x 10"^ , solution ^approaches 19181.8 in 
an oscillatory manner. . . ' 

(c) A = 4.000, B = 1-0 X 10"^ solution becomes negative Cextinction) ^ 

(d) ' A = 1-993, B = .93 X 10"^ , solution oscillates to 21522.7. 

(e) A .= 2.011, B = 1-11'x 10"^ , solution oscillates without 

convergence. • ' • " . " 

- - ^ 

(f) A = 3.007, B = 1,07 X 10"^. solution becomes negatived 

\ ^ ■ . 

(g) A = 2-998, B '= -98 x 10^^ *, solution oscillates without - ' 

convergence. ^ ' ' ' 



.The correct conjecture for = 10°° ^ ^ .0001 is that for 

0 < A <^ 1 , we have monotone convergence (to A/B) ; for 1 < A < 2 , we ' 
have oscillatory convergence (to A/B) ; for 2 ± A <^ 3 , we have finite 
oscillations;, and for A > 3 , the soliiti^n becomes negative (extinction). 

vThese results for A hold in general, so long as 



1 + A 

No < 
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If, however, ^ 

w ^ 1 + A 
No > 

y • ' -■• 

then the population;-; becomes extinct^^a^egardless of the value of A . A, 
proof of these and related results may be found on page 74 of -'the Quant.. 

Math. (Oxford), 1936, in an article by T. W. Chaundy and Eric Phillips • 
In the text, below, we give only a heuristic derivatioa to these results. 
However, pur methods also apply to more .difficult difference equations. 



^ 8-1.11 

1.2 The United State Census 

HDw good is this model, (1-2)? One way to test ^he model is to use data from 
an actual population. To this end we look at the United States census. We start \ 
in 1890 (the first census with^ 48 states). The census figures (in millions) for the 
48 contiguous states 



<g 1890 

1900 
' • 1910 
1920 

* - . 1930 
• 1940 
; V ■ " 1950 

. . ' ■ ; 1960 

1970 

. " ■ ■ \ - ■ 

where Alaska and Hawaii have -K^ en subtracted from the 1960 and^970 figures. A 
program which asks for values of A ' and B , the initial census year and its 
population, and a final year to be predicted follows: 




100 FRZHT "TYPE VMLUS FOR A" 

. too INPUT A. ' Jt 

300 PRINT "TYPE VALUE FOR B" - 
AOO INPUT B, 

500 PRINT -TYPE YEAR' OF INITIAL CENSUS** 
600 INPUT Y 

700 PRINT "TYPE POPULATION IN YEAR JUST TYPED" 
- 800 INPUT N 

^ \ 900 PRINT "TYPE YEAR OF FINAL CENSUS TO BE PREDICTED" 
1000 INPUT F 
ilOO PRINT 

1800 PRINT "YEAR", "POPULATION" 

1400 PRINT Y^N 

1500 IF Y>«F THEN 2000 

1600 LET N>C1>A*B«N)*N 

1700 LET Y-Y+IO 

1900 «0 TO 1400 

8000 END 
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fie. use values of 



A = .2329121 



B = .0006710713 



and start with 1890 and. a population of 62,948. The results through the yfear 



2200 a.T^i 



TYPE VALUE F0R A 
•8329121 

TYPE VALUE FAR B 

? 

6-710713E-4 ' 
TfPE YEAR 0F INITIAL CENSUS, 

? - * . - i ■ 

1890 / 

TYPE P0PULATI0N IN YEAR JUST TYPED 

7 ' • 

62*948 

TYPE YEAR 0F FINAL CENSUS T0 BE PREDICTED 
? 

3000 



YEAR 
1890 
1900 
1910 
1920 
1930 
1940 
1950 
1960 
1970 

1980 
1990 
20O0 
2010 
2020 
2030 
2O40 
2050 
2060 
2070 
2080 
2090 
2100 
2110 
2120 
2130 
2140 
2150 
2160 
21 70 
2180 
2190 
2200 



P0PULATI0N 
62.948 
74.95026 
88.63732 

, 104.0097 
120.9752 
139.3306 
158.7549 
178.8177 
199.0085 

218.7626 
237.6184 
25S*0722 
270*8205 

284.679 

296.5991 

306.6458 

314.9654 

321.7522 

327.2199 

331.5798 

335.0277 

337.7363 

339.8529 

341.5 , 

342.7776 

343. 7662 

344.5295 

345. 1 18 

345.5713 

345.92 

346. 1881 

346.3942 



ERIC 



2. 



Notice that through 1970 the predictions are reasonably accurate- On the basis of 
this agreement with the victual census figures then we. can, at least tentatively, 
accept the model as being representative of the United' States population with the 
given yalues of A and*' B We then use the same equation to predrfct the future 

* ■ r" • ^ . - ■ 

population of the United States- The figures, from 2210 to 2400 are: 



2210 - 


346.55S4 


2220 


346. 67-4 


2230 


346.7673 


2240 


346.8389 


2250 


346.5939 


2^60 


346?^^36~" 


2270 


346.9684 


2280 


346.9938 


2290 


347.0123 


2300 


347.0269 


2310 


347.0381 


2320 


347.0467 


2330 


347.0533 


2340 


347.0584 


2350 


347.0623 


2360 


347.0652 


2370 


347.0675 


2380 


347.0693 


2390 


347.0706 


2400 


347.0^16 



ft 



* The values ^of A and B were actually chosen in a way whidh produces good 
- estimates of the population figures through 1970. For-^an ' arbitrary population 
it is not^ always possible to make such a judicious choice- 



"iNotice from these last results that the population seems to be leveling off at . 

about 347 million, and it reaches that value by 2290. -There are some modest gains 

in population thereafter but one. century later the population has only increased 

* • 

by another .06 million (about l/50th of IZ) . . ^ 



Self-Study: Problem #1.3 



The U.S. Censiis population of Colorado ^d Alabama (in thousands of people) 



were: 



Yiear 

1890 
1900 
1910 
1920 

5?:v 1930 

•^1940 

i960 
1970 



Colorado 

413 
540 
799 
940 
1036 
1123 
1325 
1754 
2207 



Alabama 

1513 
' 1829 
• 2138 
2348 
. 4 2646 
2833 
3062 
3267 
3444 



(a) Using _A = .3165 and B = 7.82 x 10"^ and Nq = 413, calculate the ■.- 
successive populations of Colorado? What is the equilibrium population? 
Comment On the appropriateness of the model in this case. 

(b) Using A = ,3155 and B = 8.394 x 10"^ and Nq = 1513, calculate the 
successive populations of Alabama? What is the equilibrium population?' 
Comment on the appropriateness of the model in this case. 



Solution to Self-Study: Eroblem #1._3 \ ' . 

_ _ ^ _ . ^ _ ^^^^ , . 

(a) . Colorado Calculated Population 



1890 


413.0 






1900 . 


530.4 






1910 • . 


676.2 






1920 - 


854. "5 






1930 


1067.9 






1§40 


1316.7 






19,50 
1960 


1597.8 
. 1903.9 




X 


1970 . 


'2223.0 







■ Equilibrium population = 4047.3 thousand:. ^ ■ 

' The- model does not appear to be satisfactory. Colorado 
has had considerable innnigration and apparently over 
population presumes have not seriously affected growth 
to date. . Not!Lce that in recent decades the actual population 
exceeds the calculated population. 'Of course, different 
values for A and B might improve matters^ but the values 
' used herev/were chosen in a way which makes them a good choice 
In particular , the values- of A and B are least square 
approximations* 

(b)v Alabama Calculated Population / - 

1890 :. 1513.0 



EKLC 



1900 1798.2 

1910 . 2094.1 

L920 ^2386.7 

1930 2661.6 

1940 ' ^ . . 2906.7 

1950 -3114.5 



7 



A la b a m a Calciilated Fopulatxpn 

'i960. r 3282.9 • ^ 

1970 ^ • 3414.0 

•• ■• . X i 

Eqi rfl-Tb rimtt population = 3758*6 "^V^ ^ 

The model' appears ^Lte good. The population of Alabama is 
^ relatively stable and overpopulation forces are starting to 
be felt* 
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Self Study; Problem //1. 4 

In 1920 Pearl and Reed (see Proceedings of 01 ational Academy of Sciences, Vol, 6, 
275- and also Lptka, Etements of Mathematical Biology ^ Dover, 1956, pp. 66-69) 
used the following census data, to predict the equilibrium population of the United 
States: . - ' 

■ •;■ ' ^ • ' ^ . ' " 

Year Population (x 100 ,000) ' - 

1790 3.929 

1800 5.308 • . • 

1810 ' 7.. 240' . 

' * 1820 ■ 9.638 

1830 - 12.866 . i 

. ^ • 1840 17.069 

, . 1850 23.192 

1860 ■ 31.443 

1870 . ■ . 38.558 , . 

1880. ' " 50.156 " ' 

. ■ 1890 62.948 • 

1900 75.995 

1910 91.972 

Using A = .3641 and B = 2.209 x 10"^ and Nq = 3.929 , estimate the U.S. 
population. What is the equilibrium population? Compare these results with those 
given in the text here. Explain the discrepancies. 
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Solution to Self -Study;- Problem //1. 4 

Year - . Fopulation (x 100,000) 

1790 3.929 

1800^ " 5.325 

p ' 1810 . * 7.202 

1820 ^ 9.709 , 

1830 • . 13.036. . ' 

1840 ■ ' 17.407 

1850 . 23.076 V"^ ■ f 

1860 ' '30.302 

1870 39.306 

1880 50.205 ^ . 

1890 ' 62,917 ^ , 

1900 } . ^ 77.080 » ^ 

1910' 92.020 

1920 ' 106,820 

1930 120,507 
, \ 1940 ■ 132.305 

The equilibrium population is 164,8 , 

These results are much lower- than tiiose in the text. Moreover, this 
equilibirium population was exceeded in fact before 1960, Hence the results 
in the' text seem mor^appropriate. ^ 

A glance at thfe census data will show, that Peatl and Reed did not 
include territoriefS in their data. In 1790, for example, only 17 states 
were tak5n into acc.ou^t while the 1910 figure included 48 states. Hence 
the area whose .population was counted changed from census to census thereby 
contaminating the/data-^ 



FRir . 




Self-Stttdy: Problem g 1.5 ? 

Lotka (see above p. 70) gives the following data fbr growth of a bacteria • 
colony* 

' . Age of Colony (in days) ■ ^ Area Covered (in cm^) 

' 0 0.24 

^1 • ■ V 2.78 

- ' 2 ' 13.53 " - 

rr 3 . . 36.30 ". ' 

^ 4 ' \ 47.50 

5 • ' 4^.40 



Using A = 6.525 and. B = 0.1609 and Nq = 0\24 , calculate the size of the 
colony in square centi^i^ters.' What is the equilibrium size? Explain the results- 
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Solution to Self-Study; Problem //1. 5 

■. * ■ ^ 
Age Size 

•. > 

,0, ■ ' b.2A . . " 

. 1- . ' 1.797 - 

- 2 13.001 - . 

3 ■ * 70". 636 . • 

4 , -271.269 ' . . ■ 

5 . -13881.390 ^ 

/ ■ " • 

The equilibrium. size is 40.55'. The difficulty lies in the rate at which 
the population reproduces. " The observations were made in days but the 
reproductive span for bacteria is much shorter. Thus the discrete model 
is inappj^jj^iate (see Section 2.1). 

^Different values of A and B might -improve the agreement between 
^he calculated and actual values. See also Self-Study Problem #2.1 in 
Chapter *II. • . 
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1>3 Equllibriuin and Stability ^ ^ 



The value which the population seems to be approaching is called the 
equ£tii^riim poputcrtion. We will discuss how to coii5)ute this equilibrium population 
in this • section - It will turn out that if the population ever reaches its 
equilibrium value, it will remain there. 

Another interesting question whicji ar^^es in connection with equilibrium 
populaticSa is: Suppose a population is in equilibrium and some catastrophe (such 
as a flood) kills a significant porti^on of the population, will the population 
return to its equilibrium value??t We could- ask the same question with regard to a 
certain influx of ^people through say immigration. That is, if a population in' 
equilibrium is increased by a sudden flood of immigration, will the population 
decrease to its equilibriumr value? Populations which do return to their equilibrium 

value when subjected to a sudden, but reasonably small change, are called stable. ^ 

■ ' S J ■ 

Populations that, when disturbed, do not return to equilibrium are oaU.e.d icnstdbZe. 

Now if the population is in equilibrium then the population is not changing, 
-i.e: , ' , V 



If we set 



"(E for "equilibrium") then from (1-2) 
(1.3) * > ' . 0 = (A - B Ng) • 



From thi& it follows, that either 



er|c ^ 



9 ' . 
or" 
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(1.5) 



= A/B 



These, are the two equilibrium populations. If Nq equals either 0 or A/B 
then all succeeding populations also equal either 0 or A/B . For the United 

States census we used A = .2329121 and B = .0006710713 so A/B = 347.0750 ; f 

■ > 

which is quite close to the numbers produced by the computer program for the years 

^ 2300 and beyond. . , 

To test the stability of the .solutions we could try startdLng the population 
either above or below A/B or above 0 and see if the population seems to return 
to the equilibrium value. We should, of course, try different combinations of A 
and B since stability may depend upon the choice of A^ and B . The computer 
programs in the previous section are ideal for conducting such experiments of stability. 

Suppose for example we let A = .5 and B = .0001 then J= 5000 . The 
res'ults of this program have been shown on pages 6 and 7 . A sketch of the 
population growth as indicated by these "results is shown in Figure 1.1. The sketch 
is an S-shaped curve and is typical of the behavior of populations in which there 

. is a braking effect. The^ equilibrium, 5000, appears to be stable. 

WilX the population always follow on S-shaped curve if the equilibrium is stable?. 
We try A = 1.5 and B = .0001 . * The equilibrium population is ,15000 . The 
numerical resiilts are not shown^, but. a sketch of ihe results is given/ in Figure 1.2. 

'This certainly is not an S-shaped curve, but equilibrium appears to be stable. -Thus 
both A = .5 and A = 1.5 - produced a stable equilibrium. Is the equilibritim always 
stable in this model? '.^ 

For A = 4' and' B = .0001 , the equilibrium population is 40000 . If we 
start with Nq = 1000 the BASIC- program produces the following results: 



ERIC 
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Figure 1.4 
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RUN 
N01 



i 



TYPE VALUE FOR A 
74 

TYPE VALUE FOR.B 
7.0001 

TYPE INITIAL POPULATIO:a 
71000 

TYPE MO. OF PREDICTIONS 

78 V 

PERIOD POPULATION 

0 1000 

1 4900 

2 22099 

3 - 61658.4 
^ -71884. 

5 -876151. 

6 ' -8-I1448E+07 

7 ■ -6.588 53E>11 

8 -4.34087E-I-19 

DONE 



A sketch of these results appears in Figure 1-3- Notice that at point A the 
population Is negative, i.e., the species has become extinct. In one sense this 
again represents stability — zero population. But the violent behavior is a clue 
that all is not well with our model. » : 

Where is the source of the '<iifficulty? The only parameter "which we have 
changed is . ;^For A = .5 or 1.5 , the equilibrium A/B was stable. For A - 4 
it decidedly was not. A reasonable course pf action is to try some values of A 
between 1.5 and 4 . If we use A = 2 with B = .0001 we will produce Figure 1.4. . 
A value of A = 3 yields Figure 1.5. Neither is stable. 

We could, of cqprsBy continue to experiment with different values of A , but 
even with these results we can begin to make some 'educated guesses V, and it would 
seem appropriate to delay any further experiments until we have analysed the. 
results already obtained a little more thoroughly. 



o 3 * 
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It appears that if A 2 , stability is lost. On the other hand, for 
A <^ 1.5 , the- equilibrium is stable. For values of A between 1.5 and 2 , 
the question of stability is unanswered. But remember — we have restricted - 
ourselves to one value of B (Be =^ .0001) and have always started with Nq = 1000. 

Tim task of varying A , 5 and Nq to determine which combinations- of ■• 
values produce stability appears hopeless due to the large number of cases which 
must be examined. For example, if we usie five different values of A' (as we did 
here) and also five different values of B. - and Nq then there are 125 cases. 
The volume of data would become overwhelming and extremely difficult to analyse. ' , 
Therefore, we look for some more, profitable- way of studying stability. However, 
our experiments' have not been wasted. They have given us quite a few, clues which 
we can use in our analysis. In particular, from our numerical results we expect 
"to find stable equilibrium for the smaller values of ' A . • 

1.4 Determination of Stability 

* ' ... 

Suppose the population at some point .is disturbed from its equilibrium value.^ 

Suppos^ further that the disfurbance is "small". Then 

where n^ is small. Similarly then let^ 

* ■ 

where n, may or may not be small. Using (1.6) and (1.7) in- (1.2) 



We will say shortly what we mean by "small". Oo 

FRir 
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or ' 

Hov satisfies (1.3) so this last equation reduces to 

• n^^ ^ (1 + A - BN^)nj^ - BN^n^ - Bnj^2 

• or . * 

(1.8) . " J nj^^^^ (l + A- 2BN^)nj^^^ Bn^2 , • 

Now since n^^ Is small^ we will neglect terms In n^^^ compared to n^^ . l^n fact 
this is the de^ir^tlon of the word "small" as used here. I.e. , that ^ 

neglected compared to the terms in n^^ In any case we will ignore the term 

■* # 

and write ' . 

(1.9) - \ ■ . lij^^ = (1 + A - 2BN^)i^ ' 

This is a linear, first order difference equation for n^^ . If 

|l + A - 2BNg| < 1 • ■ ■ ' " 

then n^ approaches zero as k increases. In this case Nj^ approaches as 

k- increases and the equilibriiim population is' stable • If, on the other hand, 

- , • ./ ' ■ - . 

V [ 1 + A - 2BNg| ^1 

then n^ does not decrease as k increases and the -equilibritim solution is ' ' 
txQstable. 

We now' examine the two equilibrium populations 0 and A/B for stability. 
First if : . 

> ■ . 

o 

ERIC 



then (1.9) becomes 



and since A > 0 it follows that - |1 + A| > 1- so the solution 0 is unstable. 
Next consider 

•- • ■ \ ■ ■ N^= A/B. 

then (1.9) becomes . ' * , 



If 



(1.10) 



0 A < 2 



then 



1 - -A < 1 



and the solution is stable. Otherwise^ it is^ unstable. The conclusion then is : ^ 
The equiZibi*itim papulation 0^ is- never stable. The equilibrium population A/B 
is. stable for 0 < A < 2 and is unstable for A >_ 2 . ' . ' 

This certainly agrees with the numerical experiments which we performed at 
the close of the previous section." Just to be sure, however, we should try some 
other values x)f B . and/or Nq^- Suppose we return to ''A= .5 and B = .0001. 
This produced the S-shaped curve in Figure 1. Rather thctnstart with Nq = 1000, 
we use an initial population which exceeds ^£ - will try " Nq = 15000 . 

The results are:- ' . - ^ 
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RUM 
N0I 

TYPE VALUE FOR A 
7.5 

TYPE UALUE FOR 13 
7*0001 

TYPE INITIAL POPULATiaa 

^715000 
TYPE NO. pF PREDICTIOMS. 



710 

PERIOD 
'0 
1 
2 

3 T 

4 

.5 
6 
7 
8 

■ 9 ■ ■ 
10 

DON^ 



POPULATIC?? 
15000 
0 
0 
0 
0" 
0 
0 
0 
0 

0 - 
0 




. These results are somewhat surprising. The value of A is considerably less 
t^an 2 , yet stability does not result. Apparently 0 < A < 2 is not sufficient 
to guarantee stability. Is there a flaw in our -a n a ly sis? 

Recall that in th6 argument which led to 0 < A < 2 , we neglected terms in 
xx^ in (1.8). We justified neglecting these terms in nj^^ on the basis thi^^t^they 
were *small' compared to the terms in n, . We now examine what neglecting these* 
terms im^>lies about the validity of* our stability condition. 

RetumdLng .to (1.8), ^ we are to neglect the term -BUj^^ then ,it must\be 
small compared to the terms in n^^ , i.e. > ■' ^ ^ .... 



Bnj^2 « |l + A - 2BNj 



For N„ == A/B this becomes 



« 



1 - A 



HI - - . B 
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Siace we have concluded that \ . - ■ . 

=a ■ • . ■ ■ 

is necessary for stability, this condition may be rewritten 

: . . « ^ .for all k . ' . 
From this and (1. 6) we obtain 



or . . ■■ ■ ' 

(1-llX :. . N, « ^"t^ for all k 

k B 



For A = .5 and B = . 0001, the right side of this last inequality "is 5000'as is 
A/ft so, Nj^ « 10000 . '.Since this must hold for all k , it urust hold for k = 0, 

No « 10,000 

Thus when we used Nq = 15,000 we violated (1.11), i.e., we allowed no to be 
so large that we couid not safely neglect the term Sn^^ in (1.8)-. 

The conditions (1.10) and (1.11) are necessary conditions 'for stability of . 
the equilibrium value, A/B . But some unanswered questions stili remain. \, Are ^ 
they also sufficient to guarantee stability? How are we to verify (l.llX since . 
it mus.t hold for alt k ? ■ / 

The rather complex analysis of Chaundy and Phillips cited above shows that 
the stability condition (1.11) can be strengthened to \ 



(1.12) ' 0 < No < ^^^^ ■ ' ' . ^ 

This together with (l.lO)^are both necessary and sufficient conditions for convergence 
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to the equilibrium value A/B • Moreover, the convergence is monotone for 



0.< A < 1 . 



\The analysis we have given here was confined to 'small' disturbances from 
<\ equilibrium [recall (1.11)]. Such an analysis, therefore^ applies only i^o ZocaCl 



stability, i.e. , not too far away from 1p|uilibrium. Typically it also produces 
only necessary conditions which may be oyerly restrictive. "Nevertheless the 
analysis is straightforward and does at least produce conditions which, if ^ 
satisfied, guarantees stability. \ 

Chaundry and Phillips have used 'a more powerful analysis Which avoids the 
question of 'smallness' of ^ • tfence they deal with gldbaZ stability. Such 
an analysis xjsually is impossible to naxvy out. Even a brief glance at their ; 
paper will indicate the difficulty for even this relatively simple equation. 
Yet when a global analysis cap be carried out, it produces stronger and more 
useful results. . , • 

Local stabi^Lity is easily verified using the procedures described .above , i.e., 
add a 'small' disturbance, neglect all non-linear terms ^ solve the resulting linear 
equation and, finally,- investigate the 'size' of the neglected terms Jto determine 
what 'small' TDoeans. Global stability follows ne such pattern aad> indeed, cannot 
be .^carried out at all in most cases. ' / ; ' 

1.5 A More Refined Model ^ - / 

.So far we have discussed a constant rate of population growth, i.e. . - 

R = A 

which lead to (1.1). We also have discussed a rate of growth which decreased as 
the population increased ' ' 

■ ' ■ ' .' . • ^; . • ■ - ' ■ • ' ■' ' ' ■ ' ' ' 

^ • • . ' , " • R = A - BN 



. a. 
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with A > 0 and- B > 0 . This lead to (1.2). If we plot these rates of growth 
.as functions of the population we obtain the curves in Figures 1.6 and 1.7. 

We observe that in Fi^giire 1'. 7 the rate of growth R is negative for 
N > A/B • One interpretation of this negative growth rate, is over crowding 

puts .a brake on the growth. Indeed, we could have motivated (1.2) by postulating 
that for N greater than some /positive value N , the effect of over crowding 
should make tKe irate of growth negative. The simplest rate of growth which is 



,c positive for N < N and negative for N > N„ jls the lineaflP function 



R = B(Ng - N) 



so t"he model would be 




If we write - " . - 

.- ' ■ - . ■ ■ ' . 

we obtain (1.2). / V ' . ^. • / 

We can extend this model by assuming that there i,s -some minimal population, N y 
below whi©h the rate of growth is again negative because there are so few individuals 
that they cannot . survive in their environment. If we retain the assximptiori that- 
for N > N , overcrowding causes a negative rate of growth,, then R must be 

negative for N < N. , positive for .N < N < N_ and negative for N > N_ . The 

e e Jc* r* 

simplest such function R is the quadratic 



(1.13) 



R = -C(n/- Ng) (N - N^) . 



where 



0 < N < 

e E 



ERLC 



4i 
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T 

1. 



-Ml _ 



Figure 1,6 



R= A-BM 




Figure 1.7 
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and C > 0 . We depict this rate of 'growth in» Figure 1.3. The e and E stand . 

for "equilibrittm" and, .as we sljall see, they are indeed" equilibrium solutions. We 

■ *' ' ■ * • 

'also label the maximum^ value of R as . The difference equation is 

(1-14) . Nj^l = [1 - CCNj^ - N^) (Nj^ - Ng)]Nj^.. , 0 <^N^ < N^^ . 

The equilibrium solutions are the valu^ of suchvthat^ . , ' 

. N = N = N ' • 



or 



N = (1 - C(N - N^) (N - N^))N 



Thus either 

- N = 0 

or " 



/ 



-. . C(N - N ) (N T N„) = 0 .; ■.- 

' ' ' e " ' *^ . ■ ■ • 

. . ■ ■ . - ■ . .» • " 

which leads to the values ^ and N_ There are, therefore three equilibrium 

< e h* . 

' ' ' ■ •» • 

populations: ...^ 

0, N and . ■> ■ 

e t, . ■ , . ■ ^ ■ ■ • 

• ■ ■ ■/ ■ . ' ■ ■ _ . . :\ ■ " ^ . . - ^ ■■; ; 

Of the three parameters C , N- , N the latter two have direct biological 
• e ill . ' 

interpretations. - It is desirable to also replace C by^ a biologically meaningful * 
quantity. Thtis we introduce - the maximum rate of growth shown in Figure 1:8. :^ 



Bf we set 
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Thus we may write 



R - ^^C(N - N ) (N - N-) 
e^ r* 



, . = -C(N - N„ +.(N„ \N^))(N - N„ + (Nj^ - N^)) • 



= -CCN.- ^-Jk ) (N - Nm - - ) 



M 



In this latter fortijr, it is clear that the maximum value of R occurs for 

N = N„ and is given by 



M 



Thtis 
(1.15) 

ERIC 



/ 4 



c = 



4 7 



and our . model may be written as ' /- ' 

(±16) , N = ri - 4iL (Ny - Np) (N^^ - Ng) ^ ' ■ 

e 

Using an analysis quite similar* to the one in Section 1,4 we fin'd that the three 
equilibrium valuer are^ stable under the following conditions: 

Equilibrium Value Stable When 



■ 0 



< 1 



E - 



N . . .. ^^Never 

e I - 



While these do not appear to be very enlightening, let us consider the case when 
Ng is much larger than (the largest Equilibrium population is much larger 

than the smallest non-zero eqiiilibrium population). Then write 

N ' . 



(N_ - N )2 ^ N ' 
■E e n ^ ^ ^2 

- 

The denominator on the right is close to 1 so we replace the left hand memfcer by 
the ntomerator on the right. The numerator// then should be les9 than 1 for stability. 
Thus . , • 

• R <:i ^ ' - • •. 

, ^ 2 



In this case we let = + and neglect terms in n^^ and n^- 
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Since is much larger than N , the right side is very large. It follows then 

that imder these conditions 0 is always stable. 

■ « ■ . ■ \ . - _ ^ 

• More interesting is the equilibrium value N^^ '. Rewrite 

Again this should be less than 1 for' stability or - , 

^ < 1/2 



This says that if >> then if the maxiinuin rate of growth does not exceed 1/2, 

is a stable equilibrium value. On the other hand, if 1/2 then N^, is 

unstable. Qualitatively this . says that a high degree of correction in the system 
(steep parabola) renders unstable., while a low degree of correction leaves 

stable. 



1>6 Some Numerical Experiments 

We now write a program to test the model described in the. previous section 

^ . • ■ . ■ " ^ ■ ■ ■ " J 

The program is as follows:. ( 
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100 PHINT "TTPE SMALLEST EQUILIBKiUM FaPULATiaN** 

200 INPUT HI 

300 PKINT "TYPE LARGEST EUUILIBKIUM P3PULATI0>i" 

400. INPUT N2 . 

500 PKINT "TYPE MAXIMUM HATE 3F GtO WTH" 

600 INPUT i< . " . 

.700 PKINT '^TYPE INITIAL PaPuCATl 0N" 

800 INPUT N ' 

9Q0 PKINT "TYPE Na. 0F FUTUKE - PKEDI CT I 0NS" 

1000 INPUT M ^ - - 

1 100 ' \> 

.1200 PKINT "PEKiaL)"#"PC5PULATI0N" ^ ~ 

1300 F^K 1=0 Ta M ' 

140O PKINT I>N 

1500 LET N = <1-4*K*CN-N1 )*<N-N2W<N2-Nl>t2)*N 

1600 NEXT I 

1700 END - ^ - ' . 

We will use this program to verify the stability behavior predicted for . Thus, 

we will take « and try values of below and above 1/2 . For E^^ < 1/2 

the solution should be stable. 

We try first - = 1/8 . The results are: 

TYPE SMALLEST EQUILIBRIUM PflPULATIVN 

#? ■ ' ■ - ^ . " 

? -^^-^^ 
100 V 

TYPE LAKGEST EUUILIBKIUM P0PULATI0M 

? ' • ■ ' 

10000 . ^ 

TYPE MAXIMUM KATE CJF GK0WTH 
■* ' ? 

• 125 

TYPE INITIAL P0PULATI0N 
? 

750 



TYPE N3. 0F rUTURE PREDICTI0NS 

? 

40 



■ * 
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Vj 




PERIOD 


PBPULATI0N 


0 


750 


* 1 


773»0047 


2 


797« 493 1 


3 


823*607 


- 4 


851 • 50*4 


S 


884 •3719 


6 


913* 4084 


7 


947* 8493 


i 8 


984»9609 


9 


1 025 ♦ 049 


10 


1068*464 


1 1 


1 1 15*612 


12 


1 1 66*966 


13 


1223*073 


14 - 


1284*576 


15 


1352*233 


16 


1426*937 


** 

1 7 


1 509*748 


. 1 8 


1601^934 


19 - 


170S«0^4 


20 


1820*818^ 


21 ' 


1951 ^559 


22 


2099*923 


23 


2269* 181 


24 


2463*31 


2$ 


2687* 141 


26 


2946* 497 


27 


3248*299 


28 


3600*543 


,29 


4012*021 


30 


4491*472 


31 


5045*758 


32 


5676*.478 


33 


6374*672 


34 


71 14*44 


35 , 


7849*061 


36 


8516*474 


37 


9058*955 


'38 


, 9448*579 


39 


9697*061 


40 


9840*886 



A graph of these results starting at the 21st period is shown in Figure 1»9. 

Notice that N = 10,000 ,is stable and that' » N . 

E E e 
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Notice also that the populatibn increases in each period gradually approaching 
much' as our earlier model with R = A - BN did. 

Next we try a larger value of i.e. , R^^ = 3/8 . This is still lesq^ 

than 1/2 and thus should be. a. stable solution. The results are: 



c 



TYPE SMALLEST EQUILIBRIUM PdPULATiaN 

? . 

100 ' ' \ ' ■ ' 

TYPE LAKGEST EUUI LI BKI UM ' P0PULATr3!VI 

10000 ' 
TYPE MAXIMUM KATC 3F Gi^0WTH 

• 3 TS 

• TYPE INITIAL PaPULATiaN 



750 

TYPE N0- 9F FUTUKE PREDICTI SNS 

40 . ' . ■ ' 



PEKi(5D- 


P0PULATI0^f 


0 / 


750 


1 


819.014 


2 


,901-7585 


3 * 


1002.431 


A 


1 127.002. 
1284. 178 


5 


■ 6. ■■- 


.1 487.026 


7 


/ 1755.75 


8 


2122.549 


9 


2640.113 


10 


3395.496 


11 


4526.555 


12 . 


6205.032 


K3 


8405.226 


14 


10109.03 


15 


9940. 19 


16 


10029.73 


1 7 


9984.418 


18 


10007.95 


19 


9995.884 


20 


10002. 12 



'Si- 



. . . 21 - 99.98.909^ 

/- .', ' . 22 . 10000.56 

\ . 23 ^ .'9999.711 V 

, ' . 24 - ■• - ' lOOOO^lS ■ < 

-* • ' . ' 2^ .- 9999.923 ^ • , 

26 ' 10000.04 

.; ■ ; " - 27 • 9999. 9B 

' 2S - . , 10000.01 

; ' ' 29 . 9999.995 

; V .• "SO ' 10000. 

' 31 - 9999.999 

. •■ \ ' 32 ■\ . 10000. 

■ ■ ■ . 33 - M.OOOO. 

; , 3^ 10000. - 

V 35 10000. 

. ■ . .. • 36 loooe . 

37 10000 

\ 38 10000 

• ;.\: ' . .- 39 lOOOO- 

pr^ - . . ' ' - 40 ' 10000 

A.graph' of these results is shown in Figure 1.10. In this case the solution 
:oscillates about . and. eventually -reaches 

> . ' Finail-y we Jtry Ej^ = 5/8' which exceeds 1/2 . Thus we ^would expect ' N 

-be unstable,. The numerical results are: - 



TYPE. S«AlLeST. equilibrium P0PULATI0N 

■-■•#? ' .-" ' - - -'. 

-?■-•'.". " 

ioo , . , 

TYPE LARGEST EdUILIBKlUM P0PULATI0N 

',?'-- 

ioooo / 

-TYPE MAXIMUM KATE- 0F GR0WT/H 



.-?- V -t- 

TYPE INITIAL P0PULATI0N 

?' . • • ■• 

■750 ' 

TYPE 0F FUTUKE PKEDICTI0NS 







pep I an 


P0PULATI0N 


n 

\j ... 


750 


1 


865*0233 




1019*222 




1233*843 




1546*661 




2029* 119 




2824*989 


7 ^ 


4233*868 


8 ^ 


6808* 103 


■ 9 


10526* 4 




9052* 727 


t- I 


11011 *03 


IP 

I & ^ 


7912.706 


1 

I O 


1 1204* 1 


1 A 
I 


7382*966 


1 S 


10972*34 


1 A 


801 3. 59 


17 % 


11226*8 


1 8 


7317*763 


19 


10931 #43 


20 


81 18*356 




j 11242*71 


22 


7271*692 


o 


10900*97 


2^ 


8195*097 


PS 


1 1249*31 


2 A 


7252*492 


27 


10887*9 


28 


8227*697 


P9 


1 1250*8 


30 


7248* 147 


31 


10884*91 


^ ■ 

. 


8235* 121 


O • 


1 1251 *03 




7247*479 




10884*45 


♦JO 1 


8236*264 




1 1251 *06 


38 ^ 


V 7247*387 


39 . ' 


\ 10884*39 


40 


/ 8236*422 
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i 



A graph of these results is shown in Figure 1-11- Notice "that the solution oscillates 
rfbout N„ with varying amplitude. Our analysis would seem to indicate thatf the 
oscillations should increase in amplitude. However » that analysis assumed that 



\ 
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vhere n. was small. Clearly in th*s case n, is not small. Nevertheless once 



n, does become small . (N. becomes'^ close to N-, ) , the oscillations will grow, 

■ k - . / E 

• Therefore, the solutions never settles down to N^, . 



Interim Project iH 

Examine the rate of growth curve shown in Figure 1.12. The equation of that 



curve is 



R = A - C |N - b[- 



where 'A->0, B j> 0, and BC > A . The equilibrium values "are 



N = 0 



B - (A/C) 
= B + (A/C) 



The stability of these "equilibrium populations can be carried out both aiialytically 
and numerically quite analogous lys^o .the deve'iopment already given here. 
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Figure- 1-12 




. CHAPTER I 

AUtHO^' EVALUATION 
(Please circle one of the responses to each question) 
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1* Did you attend the short course in 1974-75? 
'2* Is this chapter ^ ^ 

(a) Too short 

(b) Too long 

. (c) About right 
Tf (a), which topics should be expanded? 



Yes 



■A 



No 



can you suggest topics- to be added? 



If (b) , which topics should be abbreviated? 



which topics should be' eliminated? - 



3. Could you read and understand the computer programs? 



(a) always * • 

(b) sometimes 

4. Did the interim projects seem reaisonable? 

5. Were the self-study problems 

(a) Too easy 

6. Was' the niimher of self-study problems 
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" (a) Too large^ 

(b) About right 
-(c) Too small 



62 



(c) seldom 

(d) ^never 



Yes 



No 



(b) Too difficult 



7. Did you attempt any of the self-study problems? Yes No 

8, Are the solutions to the self-study problems properly 5 
. placed (on overleaf from problem)? Yes No 

Ij^no, where would you suggest the solutions be placed? 



9. . For each topic, how solid an understanding do you think you have?' 

5? ^ Excellent Good Fair Poor 

Difference equations in general _^ 

Models of population growth ■ . . 

Assumptions in the population models ' • ' . 



Stability " i 

Equilibritmi ' ' 

Feedback 



CHAPTER II . 
POPULATION MODELS 

DETEEMINISTIC AND CONTINUOUS MODEL 

2>1 Differential Equations , - . 

In ^fhapter' I we made the assumption that the -change in population, ^ » 

during the (k + l) st ; time, period was a function of N^^ alone. There are 
circumstances where this assumption fits ^ the biological situation quite well* This 
J- is the case, for example, when the breeding group as a whole has a fixed season for 
mating and the effects of the external environment are fairly constant from time 
period to time period. In such cases it is reasonable to select the unit of time 
to be the period between mating seasons or some other 'natural' period. However, 
we have not explicitly indicated the time period, in the models examined iu Part I. 
Assuming that the period between observations, t^^^ - t^ , is a constant. At , 
our general model, ■ ^ 

(2.1) . , " ' NfcM - \ = ^k^^V ' - . ^ ' ■ 



I 



becomes 

- (2.2) - • N^R(N^) At . : 

This model, (2.2), is appropriate when there is a natural period which the 
observer regards as 'long'. In such cases, we speak of the 'nearly discrete ; case. 
The reason for the adjective", 'nearly ' is that (2.2) is rarely, if ever, exactly true. 
Even some 17-year locusts appear after only 16 years! ' 

We now wish to consider the opposite extreme; the 'nearly continuous' case. 
Bjr this, -we mean a situation in which growth takes place (almost) continuously. 
Again this idealization is never precisely true, but examples do exist where 
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♦ . populatibtis change over very short periods X)f time^ • 

Suppose for example, we wish to study a caterpillar invasion. At the height 
of such an infestation , one can almost see the larvae come to life and begin to eat 
the leaves. From our^ human point of view, at least over a span of a few days, cater 
pillars are created continuously. This example, therefore, raises the following 
point. If, as indicated, we' study the caterpillar population for^the few days of 
the 'infestation, then the nearly continuous model is appropriate.' However, if we 
stud5?' the same population making one observation a year (at the appropriate time), 
the 'nearly discrete' model applies. In these two cases (two day and yearly 
observation) we are studying two different growth processes* (larvae-to-moths , and 
annual amounts of caterpillars) even though the same population is studied for both. 
In other words the observer *s frequency of observation, provides the scale against 
which we decide whether the process is nearly discrete or neoply continuous* 

Chapter, -I-"^ as concerned with the nearly disctete case. W^^oi^ turn our 

' ^ ■ 

attention to the nearly continuous case- To study the nearly continuous case, we 

- » -. . • ■ ..I * 

'recast (2.2) in continuous notation as follows: V - 

' . t = k At, Nj^ = N(k At) = N(t) , 

and find that ' , 

- N(t + At) - N(t) = N(t) R(N(t)) At 

Since the process jis taking place almost continuously, we commit a negligible 
error by letting At approach rcro. Recall' from, the calculus .that the derivative. 



— xs defined by 
at 

dN - . N(t -h At) - N(t ) - 

-7— = Irni ^ . 

At-K)- ^ 

f 

Thus on dividing (2.2) by At -and letting At approach, zero, we find that the 
appropriate model .for the nearly continuous case is: 
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(2.4) : . ^ , - N R(N) 

Before studying the nearly continuous model (2.4), we pause to examine the 
'borderline' case. Commonly, we wish to study a situatiai in which growth can occur 
at ccny instant, but does not occur at evevy instant. In such situations either (or 
neither, if you aje^^a^essimis t) of tKe models might seem reasonable, and we wish 
to seleqX-fel^ one which is better. The correct choice basically depends dri tt\^ period 
between observations. Suppose this period is fixed f or ,a moment. If the number ot- 
births less the number of deaths within successive time periods is 'small', we 
would expect that^the continuous growth effect is negligible and that the difference 
iequatit>n model is satisfactory. Thus if . 

' - l^kfi \l " _ |N(t + At) - N(t) I ; . ^ 

Nj; - N(t) . ' . 

we would be justified in using the difference equation models of Chapter I. In this 
regard, let us return to the U.S. cerisus data cited in Section 1.2. For the decade 
1890-1900, ^ 

^k4-i ~ \ _ 76 - 63 _ - . 

while for the decade 1960-1970, we have 

^Id-I " \ . 199 ^^178 : . : 
, ^ ' N, " 178 ^- ' --^^ . 



Thus the difference equation shoicld' give' a. reasonable fit. As we have seen in . 
Section 1.2, it indeed does give a reasonable fit. 

• •/ ■ ^ 

On the other hand, the relative, growth between periods (.21 and .12 shown 
above) is not altogether negligible ,^aiid therefore it would seem that- the" differential 
equation could also be applied. Thfat is to say, the^U.S. census data is almost 
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'too close to call', and we probably should study both models since both seem to 
apply equally well and each represents a different type of approximation to reality. 

In a case, such as the U.S. census data, where the continuous and discrete 
models both seem to apply, we would naturally expect^ the solutions to the. models to 
be similar^. This is easily seen to be true since (2.2) is the classic Euler 
approximation to the differential equation (2.3) (See e.g. , pp. 366-367 of Numerical, 
Methods with F0RTRAN Case Studies hy bom and McCrackin, Wiley, 1972). 

■ In part I , we studied the discrete model (2.2) for the following particular 
choices of R : ' ' :^ ^ * 

(2.4) R = A A > 0 

(2.5) R = B(Ng - N) , = A/B, A > ;0, B > 0 . ' 

(2.-6)^ . R = -C(N - N^)(N - N^), C = 4R^/(N^ - N^)^, C.> 0, 0 < < . 

The reasoning behind the choices (2.4) , (2.5) and (2.6) for R(N) made in 
Part I is equally valid for the continuous mode! (2.3) and so we proceed t-o the 
study of these three choices. " .... 

Self-Study: Problem #2.1 ' . ' • ' ■ 

If the .data of Self-Study: Problem' #1.5 . cc-nstrued as arising from a 'border- 
line' case, decide whether one should nise the difference model or the' continuous 
. model. ' ' 



6: 



ERIC 



^ . , 8-2.5 

Solution to Self -Study; Problem j?2,l 

The successive values of (N^^^ - *^e^ 10.58 , 3.867 , 1.683 j 

0.309 and 0.040 . Since most of- these are greater than 1 , the difference ^ 
model does not appear to be satisfactory. This was borne out by Self-Study: 
. Problem #1.5, The relative growth, is far from negligible so the cCntinubus ' 
model appears to be most appropriate. 



6o 
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j2,2 iolu^fan of the Differential Equations 



' The. reader -vho Is 'faiqiliar with the elementary, theory of first order differential 
eqttatlons will obserye 'that equation •< 2. 3) is of^ the . type with separable variables • 
''Thus* we,, fo^iplly write^ " - , * . 



NJL(N) • 



and upon integrating^on both sides ^ we obtain ■ the formal solution 



. rN(t) . 



(2-7) 



J No 



dx 



= t 



where Nq * N(0) . ^ 

Although the integral on the left side of (2.7). can be evaluated explicitly for 
the choices of * R (2* 4), (2^5) and (2.6) for it is more instructive to examine the 
corresponding differential" equation directly and obtain a geometric tmderstanding of 
the nature of the solutions- To do this we need only the most irudimentary fact . 
from the Differential Cal<:ulufe , namely that the derivative of N(t)" at a po^nt, tg , 
give? L'-re slope of . the graph of N(fc)- at t = to . Thus • - , . 



dN 
dt 

-dN 
dt 

dN 
dt. 



t = tr 



> 0 implies the. graph of . N is rising at t =^ tQ 



< 0 iniplies the graph of- N is falling at^ t*=s.VPo 



= 0 implies the graph of, N is* flat at t = to 



t = to ■ ^ ■ • ' ■ , ■ 

Consider first 'the case. (21 4), the corresponding differential equa,tion is 



. dN 
dt 



= AN , A >.C 
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"Then the initial slope ( ) Tis ANq whirfi "is positive, so N rises. But 

: ' • • ■■ . ■ ■ t=0 . . ■ .. . . , • ' 

^ now the slope is even greater so N rises even faster • Thus we see that N rises 

^ ■•. •. . • ■■ ■ ' * . . ' - ■ ^ 

faster and faster as t increases and so in this case, we have the same type of' 

. behavior .as occured in the discrete case , i^e,, unbounded growth, / - 

' ' ■* . • 

r£ we recall that /the antiderivative of — is In x , then we can verify our * 

■ * ■ - ^ ^ •" ' • 

geometric conclusion by settin-g R = A in- (2,7) to obtain- 



dx 1 - N(t) 
— = — m — =- — 
X A . I 



Thus * " 

(2.8)- . N(t) = I e^^ . . 

We next consider the choice (2,5) for. R , 

' '■ ^ ^ ' 

^^^^ . . ^ = (A - BN) N , , A >^ 0 , B > 0 , = A/B - 

Just as in the discrete case, we have the two equilibrium solutions 

N := 0 and N = -N„ = A/B " ■ ' ' ■ ■• 

■ . . ' ■ - . ■ ■ • - •' " 

' dN 

- That is, if any time t , N = 0 , then = 0 for all time^ It follows that 

N = 0 fpr ail time a^^ell, and N = O is. the* solutioj^^^ (2*9) / Similarly^^^at ' 
any time t-,vN = A/B Sthen N is the solution .to^^^ for all time. If initially 

Nq ^ ^ and Nq- ^ A/B , "then the Jsolutxon^can never attain these values » • Suppose then 

"(2.10) ■ . : ; _ 0 < No. < Ng ; . 

we>conclude at qjice that fox all time^ -^y^ -V. " 

o ■'■ ■ 



C2.ll) : V . " : 0:<'N(t) < N^-' . . ^ . ' • ■ 

... ... ., _^ . ^ . - . . . . . ,^ . . ■ . - . . 

Moreover , .Since the right hand side of (2.9) is positive in' view of (2.11), th^ 
solution is increasing. The only additional fact we need to establish in order' to 
coii?ilete -our geometric* picture of the solution is that N' approaches as t ® . 

To establish this, we appeal to a monotoue convergence theorem: . 

If a function ' N(t) is .-increasing ani bounded from above , . it h^s a limit. . 
If the limit were less than A/B the fight, hand side of (2.9) would be positive 
' and hence N would continue to rise. Thu^ the limit is A/B . Typical graphs of 
H • are shown in figures 2.1 and 2^2 for initial value satisfying (2,10)» ' 

Self-Study; Problem g2>2 . 

By differentiating ^;99) and recalling the test for an inflection point, show 
that the grap^is shown in figures 2.1 and 2.2 are essentially the only cases that can 
occur wheii (2.10) is satisfied. 



\ 
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Solatlott to Seif-S tiidy : -Problem if2 ,2 

^ ^ 2BN 



At appoint of Inflection 



so : " ■ • - 



N = A/2B = Nj,72 



If ^ No < . then one inflection point exists (Figure 2.1). ; If Nq ^ 

then since N(t) Nq > /"^o inflection paintr exists (Figure 2 .,2) . ^ 



'72 



0 
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We now turn to the case in which "the initial condition satisfies 
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(i.iTTf ' ^: ' .'' ' ■ No >-Ne', ; ' \ ' , 

Heace by the |^bo(ve ^reasoning, we' sfee that the solution . . y.^ 
i) inust- remain above ^ " ' 

ii) is decreasing ' - ' . , 

- ■ ^- - ■■■■ ■■■■ • 

*."•■* ■ ■ . ■ ■ . ■ / - 

iii) approaches at t ->«>.•- . - • ; - . - • - . - 

. . Thus in all cases for jwhich Nq > 0 , the solution.-gionotonieally approaches the^ 
►^&il^ium Value A/3 . • That is , for the coht inuous^ model (2.9) ; N^== A/B is a; : 
globally stable equilibrium point. . : ^ . . 

Notice- that in contrast to the discT:ete^ analogue, the value of A ha.?- no 
: effect on the nature of the solution! / . : ^/ \ ' . ' . * • 

This fact gives rise to the question: Suppose we have a situation in which tti^ 
discrete «nd continuous mbdels both apply (borderlina case) , how can the results be 
so different? In fact, the two sets of. results- are not dif ferment. In the notation 
■. of this section, the, conditions (1; lOX ^d- (1.11)' for. monotone convergence to--A/Z 
in the discrete case become * - , . . 

1 + A At Cl/At) + A 



0 < A At < 1 , 0 < No < 



B At - ^ B 



These conditicins are obviously satisfied when the two models" both" apply. 

What a^unts for the existence "of oscillatory and divergent behaviors 
(figures 1.2, 1.3, 1.4 -and 1.5) in the discrete case and their total absence in the 
continuous case? The answer lies in tjhe rate at-which the population itself ' feeds 
back information about its own size into the growth process.. -When that Information 
is fed -back quickly (the continuous case) , violent ^behavior does not occur. On the 
other hand, an appreciable delay in supplying information can be catastrophic. To , 
better illustrate this idea of feedback 'we will use an analogy, due to .Richard Hamming, 
' Suppose you are taking , a shower and thf. water is too coldV You op,en the hot . 
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^ wate^. faucet. If additional- hot water is added immediately in response to your 
turn, the water texnpcrature gradually warms. This is- the continuous case. 

Suppose 9 however, that there is some 4^1ay in the additional hot water's arrival 
/ at the. shower head. Fgr example, if t^he hot wat&r ^ank^is empty, some time may be 
required to heat the water. Since the shower water remains cold, you continue to open 
the hotawater faucet. ,Tha result is that when the hot water does arrive, it arrives 
in a raish and your showier beconies scalding hot. So 'you frantically turn the hot 
wateY faucet hackwards (or turn on. the cold water) . -.Thus you produce violent . ^ 
oscillations in the shower's temperature for Too "cspld to too hot to too cold and . 

/ so on. The feedback is slow^ i.e. , the temperature- of the shower responds slowly . 
to the turning of the faucet This is the discrete case , x'.e. , the response (hot ' 
water) comes only after some length of time. Clearly it is thlsf<^owness of response 
that causes the pr^lem. « ^ 

We* return now to the population problem. A large, population retards growth. 

■ - ' ^ . - ' '.■ ' * ■ . 

But if the growth process itself is not aware of. the; large population it continues . 

unretarded and may produce a^huge population, one in ekcess of the eqxiilibrium value. 

This can happen in the discrete- case since a lar^e population in the middle of a 

.« ^ 

period goes unnoticed. Indeed, information flows intd the system only at period 

* ■ • . . * , " ~ ' •% 

endings. Therefore oscillatibns, and violent ones, can occur. On the other hand, 

in the continuous case the information or population size flows continuously into 

the growth process thus pr event in g\psc illations. , ^jgH^^ 

We close this portion of the dl^scus^ ion 'with one final remark. In the^discrete 

case the greater the reaction to feedback, ^he greater the oscillations^ In terms 

of the hot water* problem, the hottei; the ,water in the storage tank, the worse matters 

will become. In terms of the population model given by Figure 1.8, the stronger. the 

reaction to over- or under-population, hence the more, violent the- oscillations. -This 

- of course, 'is bom out by the instability when the peak- af the curve (I^) exceeds . 

^ Th^ oscillatory and divergent behaviors which are ^^p^ in the discrete model, can 
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occur only in the "'nearly discrete' case. 

NojSce also that the above ineqtialities may be satisfied regardless of the value 
of A 'Simply by choosing At sufficiently small. / 

Self-^Study;^" Prbblem iH.S .j^ [ ■ - 

" ^ ' IJsing the^iaethod of partial fractions, jand equations (2.1) 'and (2.5)' , /.obtain 
a soitrti^on t"o^ (2.9)' and verify our geometrical results. 
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Solution to Self-Study: 



Problem. #2.3 
P 



(2.13.> 



N, 



N 



E 



1 - (1 



Nn 



Self-S tudy ; . Pr obl^ ^ , 4 , - ^ . 

For the "choic/l (2. 9) , use geometrical reasoning to verify the . graphs shown^ in.^ 



Figuri^ 2.3 and 



Use the method of partial fractions to derive the implicit 



solution 
(2.14) 



N 



N ^ (N - Ng) ®' 
N (N - Ng) 



s: e *^ • ' " '. 

No (No -,N^) 



Finally discuss "the 'stability of the equilibrixim solutions" 
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R = -C(H-He)(N-Ng) 



Figure 2 . 3: 
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Solution to Self-Stiidy: Problem #2.4 
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, N = 0 - is stable 

. N - N ^ is unstable 
e - ^ 

N = Nj, ' .is stable. :\ 

, These results are easy to obtain geometrically, but are not so easy 
to obtain from the explicit 'solution (2.14>. 



~1 
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* * * * * * * * ******** * * * * * * * * * * * * * * *.*"* * * * * * * * * * * * 
Interim Project #2 ^^-^ 

- Consider the following jnodific^tion of (Z'.A), Suppose ?that due to medical- 
advances the equilibrium increases time increases, e.g. . ^ 

' : " - - • ' ■ N- = N„ + kt . .- ' : : ' . ^ 

where k > 0 . Now our model ^^jiecomes 

■ ■ . : . ■■ =-B(Ng"+ .kt _^ .N)N . 



or- • 



4^ = B(N^ - N) N + k B Nt .• 

(it - .- £ . . . ' 



Use some nxmerical algorithm (e*gv^ the Runge-Kutta^ Method> starting with . N(b) » Nq 
to analyze the solution of this "/model. * . . , : ' - ' 

*********** *.* ***** * .* * * * * * * * * *. * *;* * **.*,* * *' 

Interim Project #3 . ' . . . - ' 

Reconsider the U.S. census •problem discussed in part I- First use the solution 
(2.13) for the continuous analogue and .the values ^ : ' 

- ■ ■ - , . ^ ■ ■ ' - • ■ ■ ' 

A At = . 2329 B At = .00006711 - ; ;^ ' A 



to ^compute the predicted population for each- decade from 1890 to 19701: I)ecide^ ;: . : 
whether the. discrete or continuous model gives a better -fit . (say in the' sense that 

.the maximum relative^ .err^r is" smaller) . OLn Lotka's book. Elements, of Mathematical . , 

'.Biotogy-'y 'to^&Ty 1956, ^^he values . * ; . ■ . • ■- - . , 



A = .03134 • ^ A/B = 197.273^v • -f- _ ^ ^ " ' ? 



• . ■ • . ■ ■ ■ . * . ■ o 

aire cited as giving the best fit for the continuous mo-del for the years 17.9p-r91'% 



Coinpare the Lotka values for the parameters with the ones given abbve for the , 
continuous model during 1890-1970. By examining the, two sets of results for the 
continuous model, try to find values for the parameters, 'A and B , that are. better 
than either Lotka' s or ours for 1890-1970. Finally make comparisons between the" 
discrete case and the continuous case. i . c^- . /. . ^ 

4:4r*!fc:fc*%tAr4r****^*:fe.db*d(:' ************ ******* 

Interim Project- " . • / ' 
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Using a decreasing linear, function for R is only the crudest attempt to 
characterize the effect of population pressure ./^A,, more general f orm ?or R would 

be ' ' . ' ' " " . 

' : ' 'R(Nr= A - f (N) . . . 

^' ' .. ' ^ • ' ^ ' ' ^ . . . . ■ . - . '-J^' ' 

In the absence .of population pressure, the growth law 

' R(N)\ A ' ~ 



is reasonable and therefore we would expect that f (0) = 0 . Since we want R to 

■ . ■ ■ , ^' ■ • . . - " ' 

eventually %be come negative, we want R to be a decreasing function -of N . Thus 
we would expect f (N) to be an increasing function, which also f;atisfies f(N_) = A 
for a unique arguments N_ > 0. . Thus f^) might be BN^ or BN^ or BN + CN^ 
or •B'vZ ^d- so on. . Investigate soine^ functions whicMVo^ f^^l have some biological 

■ ^ • * ^' ' T ^' ' , * " ' f ■ ■ /, ■ . ' - - \ . ;■ ' ^ 

j-ustif ication. .Resaember .that, f should be diicreasing , f (0) = 0 and f (N-)' = A'^'. 

- -■ - -,- ■ ■ - - :. ' ■ • 

Use -either the discrete model (2.1) or the continuous model (2 .4); or bothf ^ , . - 



*-* * * * * *-/* * * *^ *.* * * * *•* * * * * * * 4: * * * * *. * * i: 



•;*'* .* * * * * * * '* 
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CHAPTER' II 

~l . ■ t ■ • J V 

t ' ■ • ■ . ' • • . 

/ V '. 

- AUTHORS' EVALUATION 

(Please circle on^ of the responses to each qxxestion). 

rT)±d you iattend the short course in 1^74-75?^ Yes 
Ms thi^ chapter . ' ^ 

- \ (a) Too short ' - 
^•(b) • Too long 
(c> About rigli^ 
If (a), which -topics should be expanded? 



-No 



can you -suggest topics to be added? 



If (b) , which topics should be abbreviated? 



which topics should be eliminated? 



Could you read and understand the computer programs? ' 

' - - (a) always . . . - (c) seldom 

(b) sometimes ^ (d) never' 



Did the' interim projects seem reasonable? 

.... . ■ .. • .-^ . . 

Were the self-study problems 

^ (a) Too easy 
Was the number of self-study problems ' 



Yes 



Cb) Too difficult* 



No:- 



(a) Too lar^e 
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7. Did you attempt any of the self-study problems? 

8: ^Axe the solutions to the self-study problems properly, 
placed (on overleaf from problem).?, , • 

If no, where would you suggest th6 solutions be placed? 



^es 



Yes 



No 



No 



For each topic, how solid an understanding do ^ou think .'you have? 

Excellent Good Fair Poor 



Relation between discrete and J 
crontinuous models / 

Geometriccil analysis of solution 
of differenti^ equations ' / ^ 

Equiribrium 
Stability 
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' ; CHAPTER ,111 • 

> - POPULATION MODELS 



STOCHASTIC MODELS 



^ 3^1 A Birth-Death ^fodel 

In Chapters I and II we assumed 'a birth and/or death rate which was proportional 
to the nx^pfeer of living individuals. Thus (1,1) and (2,1) both assumed that the 

difference between births* an^" deaths in a time At ..wa^/ANAt where, N is the 

f ' ■ ■ * - ' 

popmlation. At is the time interval and A is the rate of change* We <:ould have' 
arrived at this resxilt -by assuming that each indiyldtial gives birth to XAt new o 
-individuals in time At and that for each individual there are yAt 'deaths in the 
same timie. Then the net change' in the ^population J?e2? individuaZ is . XAt' - yAt. If 
^there are N individuals* the net change for the entire population is 

« - - (X-. -'y) NAt 

. • - ^ . . ■ " / ■ . ^ ' 

If we let A = X - y we arrive once more at our earlier model. 

" Using this as a guide we will now consider a similar but Xess deterministic 
procfess. In some sense this new model will also be more realistic. Rather than , . 
"assume that each individual gives birth to X'At individuals in al 
will assume that "on the^ avierage" each individual will give birth to ^'XAt 
individuals in a time At . VQne way .to achieve this end is to assume that 
individtial gives birth- to precisely one other individual, with a prbbatllity -of X'At 
' Since the probability of a birtlx^ f?:om any individual is- XAt •j.^the^ binomial law 




of probabilities shows t^t the prob'ability of exactly births ;^\.k population of 



More pi^cisely XAt + o(At). Those who wish a moire rlgoTous derivation'^should 
similarly modify the iprobabilities^'derived' below. The o(At) terps will ultims^ely' 
-Be renioved, because we ^shall later divide l>y At and let At ^ 0 1 ... \ 



size N - is p(k) = <N - k)! - ^^^""^^ (1 - XAt)^ " ^ .. . / ' 

Thus p(i) = NX'At(l - XAt)^"""" = NXAt for At small. Similarly the probability 

of precisely two births is p(2). = %N(N-r) (XAt) 2 (1-XAt)^"^ . ^- ^(N-l)(XAt)2 = 0 

• . . . n_- ' ■ ^ 

for At small. - .lii a like 'manner we can show that the probability of 3, 4, 5, 
births is also zero. Thus we conclude that the probability of two or more births 

Similarly we will assume that on the average^ each individual is responsibile 
for ^At . deaths. This leads us to assume that the -probability of one individual 

' ■ - • . ' ' ■ ' ' - • . ■■ ■ ' ■ . \ : 

dying. rin time At. is uAt . In a population of size N then the probability of ^ 
one death is ^ NyAt . Once ag^in -we will assinne that 'At is smaVisenough so that 
two or ^mor^ deaths or a ^combination of births and d'eaths "occur with such a small 
profebility in time At that these" events may be .neglected. • . ' 

-Of cpurse,. it is possible that neither a birth nor a death will occjjx in time \ 
At , Since this is the only possibility other than one birth or one death, the 
•probability of no change in a population of size N is approximately 

■ • . ' . ■ " ■ ^- = 

1- NXAt - NyAt =f 1 - N(X + y) At . ' 

Now let Pxr(t)" "be the probability that there are: N individuals' alive at time t • 
From our discussion _ JT^individiials where N > 1 can be ai^ive at time ^ t in only 
three-^aysx • ' 

V / <1) ,At'-time t - At, ^here were N - 1 individuals and a birth occurred;. 

(2) At time t — At there were N + 1 individijEals and a death occurred. , 

' * -"■ 

*- - ^ "s " ■ - ■ ' . - - * . 

(3) At^time 't - At there -were N individuals and neither a birth - nor ^a d^th 

. ■ ^ ' ■ ' ^ . " ■ . , ^ * ' 

■ occurred. , " . . ' - ^ 

F&X' N = 0 there cannot be N - 1 individtials alive -at time t - At • so onl^^he 



last two are possible in this special case. • . 

Since these three ev^ts are mutually " exclusive, the probability^ or'^^y one\pf 



these/occurring is "the s\im of the individual probabilities . .probability of 



Individuals being alive^at time t is , theref ore , the sum of . the probabilities that 
each *f these three events occurs. Thft is 



(3.1) :^-V^itV (N - DXAtp^^^Ct " m + (N-+ DyAtp^^^Ct ^ At) 

for ' N » 1,^ 2, 3,-... and *• j . ^ . " . - . 

• . ■ ■ ■ ■ ■ . r ■ ■ . . . 

(3,'2) _ p.0(t) = vAtpiXt' - At) + po(t - At) 

Subtracting ' p^(t - t) from both sides of • (3.1) dividing by At ' and taking the'limit 

as^ At 0 H i - • ' " - ■ ■ " 

for N = 1, i2, 3, . ' Carrying out this same process for (3.2) then 

(3.4) ■ • ^£0 -= 



. . dt ■ . • . , . 

This is^a system pf dif ferential^if f erence equations. 

^ . liow suppose at time^ t = 0 the population is ' I . Then 

. (3.5) " PjCO) = 1 

and ■ • . . • i 

^ (3.6) ^- p^(0) = 0 for ?t I ' -:. 

With tfies.e Initial conditions the system of equations (3,.-3) and (3.4)' may be solved. 




' • -In Section 3.3 we vill determine . the solution using ^^i^^ting vfxmctions and the 
method of characteristics tt> solve tie resulting parti^ differencial^ Later. 
- in^Section 3.:4 \^' will use a computer program to simulate the process and thereby 
* ; Estimate some /^)f -the probabilities. In particxilar we will estimate the' probability 



. pf extiiiction In time T , i.e. , we will b'ompute an approximation to p-Q 

." ■ .■ i», . 

V. We turn next to the computation of the expected value of the .population at • 
-time r and to an estimaticSh of the deviation of the population from this expected 
V2ilixe . , . ' 



Self Study: Problem #3.1 



Carry out a derivation analogous to that of the. su^ection^for'^our. ^ecpnd model 



That is , assume 



Pr(bifth) = N(ai. - bi N) 
Pr (death) = N(a2 + n2^) 



and a&sume that 



^ Pr(two or more births/deaths), - 0 



Generalize your result to the case in- which ' A 

Pr(birt;h) = N , - ' Pr (death) - N ' . 



- J 
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' 3^2 Expected Value and Variance of the Population 



Let E(t) be the expected value of the. population at time t Since a 
population . df size N occurs, at tijae t with probability . .p^(t) and since^^y 

population of size- '0., 1 , -'2\ . . ./is^ossible , ttie expected value of the population 

' '■ • ' . ' . > • - 

is . : • 

(3.7) • • ' • E(t) = I Np (t) ■ ^ . ^ ■ " 

'.Notice that the term N = 0 ^vanishes .due to the factor N in each term of the sum* 
Differentiating, both -sides of (3.7) with respect to t ^ 



- From (3.3) then 



(3.8) ^ = X ^ N(iJrl)p„ , + y I N(N+l)p._ -"(X- + m)' I n2 p^ 
N=l . N=l • N=l 



But 



I .N(N-l)p^ — I. (K+l)Kp^ 

N=i . K=0 f _ 



The first term in the sum on the right vanishes so 



The notioTl of expected value' is analogous to the -arithmetic mean of a frequency 



destribution. Suppose the, values xi , X2, occur respectively -ki , k2, */*, kn 

times. Then the relative, frequencies are k^/K, k2/K, . . . , k^/K 'where K = Z k^ and 
X = Z Xj^ /K . The notion of expected^^^varfeie arises for theoretical destributions and 
the relative frequency k^/K of xj\^ ±k i^'feplaced by the probabJ.lity" p^^ of x., -^-^ 
that E ^ Z^Xi.Px- • In equation (sVtt the are the positive integers and thfe 

situation is made^somewhat more complicated by the fact that the ^ probabilities depend 
on time. Thus the expected value of i^t?he population can be interpreted as the mean 



so 



value of the population. 



FRir 



(3.9) 

"Slmilkrly 



I N(N-l)Pjj^. » . I (N+l)Np^ 



N=l 



A- 



I N(K+l)p. 



N=l, 



N+i 



••• 1 . 



I (K-l)Kp 
K=2 ^ 
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But vi^en K « r 



so we may extend the sum on the right from K ='-1 to » so that 

■ - - ■ ■ : -k ... 



(3.10) 



i N(N+l)p = I (N-l)Np 
N=l * N=l . 



Using (3.9) a^id (3.10) in (3.8) 



II = X I (N+l)Np + y ■ I (N-l-)Np - CX +V) - I N2p^. 
N=l N=l * N=l 



The coefficient of . vanishes and we are left" with. 



But from (3.7). 



= X I. Np^^- u - l Np 
N=l N=l, 



I Np^ 
N=l •'^ 



SO 



v C3.ll) 



dE 
dt 



= a - v)E 



Moreover for t 



= 0 from '(3.7) 



E(0) . = - I Npj^(O) 



- ir=i 
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ftat from. (3.5) and (3.6) .■pjj(O) = 0 except .when N = I so 




The solution of (3.11) and (3.12) is . ' 

ft ' ■ ■ • [: ■ ■■■ . .: :.- • ^ 

,. Recalling that A = ^^^^ identical with the deterministjic solution (?:i«) . . 

''We can conclude frc4 .X3. 13) that if X. > V .(birth ra€e~exceeds death rate) that 
the' expected .-value of the population grows as time increases. On the other .hand , 
if the death rate exceeds the birth rate (y > X) , the expected value of the population 
\ decreases to zero as the- time beeves large . Finally if X = y , the expected value 
the population is^ I for all time, i..e., . 

(3.14) E = I for X = y . 

These results- certainly agree with our intuition' and, therefore, lend credence to ^ 

our model. " . . • 

Of course, the actual value of the, population will vary from the expected value 
in any pne 'case* It would be helpful 'to/have some estimate regarding how mich of a 
deviya£ion from E should be expected. Tjo that end we compute the variance'^ of the 
l>op^ation. The variance V(t) at time t" is . - 



(3.15) V(t) - I n2 p (t) - {E(t)}^ ^ / 

. . ■ N=l : . % ■ ^ : . ^ 

We will derive a differential equation for V(t) " in much the same way as. (3.11) was 
derived for E(t) . . - . - ■ ^ . V . 




The variance of a sample can be defined as \ x^^ k^/K - .(x)^ , where the k^/K 
• are the relative frequencies of the observed jralues x . . If we again replace the / 
relati^fe frequencies by the probabilities p^; , and tHe mean- by the expected value, 

-Q arrive at (3.15). 

ERJC ■ ... ■ Si 



First ve 1^^ 



so 



Using (3.3) 



But 



and 



1 '^'S)PK^i.-J,<^-rt' J/«-"' % 



Thus (3.17) becQj^^ 

From (3:7) and ' . " . ^ 

• From (3.15) a«i^^ '"l^^'^^^u ■ 
Using .(3.m to ^^H^ ag/*!*^ .v* ' 

FRir ' 
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rrom (3.18) 



dt 




2a - H + (X + v) E - 2(X - 
Ufitlng <3,i5) -and .(3.16) to repli^ H ' \— % * ^ 

(3.19) ^. . _ = ^(X - y) V + (X +.y) E ' " . . 

. ■ ■ ■' " ■ - .. " ■ . 

- , » . , ■' ■ , 

►This is a>differential equation for .v , theVvardance. For an initial condition we 
note that at - t - 0 the population is I with certainty so ' 



(3-20), : ; : \^(0) =.0 



The solution of this differential equation for X ^ y is 

. X - y - , 



Using (3,20) to determine C 



C = ^ 1 
* - y 



so ' 



V- UUi I e^^ " -^^^ {e^^ "^^^ -1> 
. X - y • 



For X v= y 

.. ■" . E" = I 



5. 



*Thi^;/ollows from setting t = 0 in . (3.15) • and lising (3.5)^ (3.6) and (3.12). 
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and from ^-l?) 




'^tegrating this "differential equaticfn.wlth tHe initjtal condition (3.20) 

. ' ' V - n It • '. ' • . - 



r ■ 



In smanary thep 
(3.22) . V - .< 



V . . . ■ _ ^ 

'2A It- " ■ " X.= V 



i We now exaiaine the behavior of the expected value 'and variaiice for large time. 
For A > y (birth rate . exceeds death -rate) both E, and V become large. /Thus while 
the expected. value of the population grows without bound, the variance also becomes 
nfinitely- large. We should, therefore, expect the deviations from the expected 

■•• ^ ■■, . 4 ■ ■ ■■■ ■ ■■ ' ■ ■ , ., ■■■ ■■■■ 

value to be large as 'titcie' increases. ' . . ^ 

' \ - ' ^ ' . * - • • . ^ • ' ■ 

For ' y > ^ (death rate exceeds birth rate) the expected value ^d the variance 



approach zero-\a^ the time increases. For large times- then the population should b€ 
close to ZBip. Later we shall see that the probability that the population is zero 
wfor large t^^^ is 1 ,. ' - ; ^ 

Finally for X =* (birth rate and death rate ^re equal) the expected value is. 
constant for all time but the -variance gr;ows linearly without boiind for increasing 
'tiine. Thus as time becomes large the deviations from the constant expected value will 
become large. At 'large times then. we •'should ei^ect the population to deviate markedly 



from . I Indeed we should expect that in a significant number of cases^ .the < 
iPOptilation will differ from*-- I by ± I If the deviation is -I thenigthe population 

, . > ■ ■ .. . ■ - ' ' - ■ . . - ■: • ". 

is zero and the species becomes extinct. The interesting fact is that even when the 



birth r^e and death rate are identical we should expfe^:t the species to become extinct 
a significant number of times for large time. Later we will see that the probability 
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Ifl i that .the popxilation will eventually become extinct when ' X « y (despite the 

fact that the expected- veJ.ue^ is^ I r).- 

A •{ ■ • , ^ ■ . * ■■ . ' . - ■ 

V' S.a SQ3.utlon: of the 'Stochastic M?<iel - , .. ^ . 

The solution for the expected value and variance of the population was obtained 
by elementary n^thods. These statistical parameters were useful in our' study of the 
mathematical model.. In order to obtad^ additional information we will need to 



* analyse the differential -difference equations (3.3) and (3.4) in more detail. The 
analysis while relatively straightforward is more sophisticated than development in 
the ^revioTis section. , ' 

~^-We turn then to ^.the problem of finding the solution V^i^) to (3** 3) and. (3*4) 
given, the initial condi^ons (3.5) and (3.6). To do so.we ihtroduce a generairing 
function . 

CO ■ 

(3.23) - - ' ^ f(x, t) = I p (t) x^. 

■ , N=0 " \~ 

We will use some of the techniques of the last section t^K^obtain a partial differential 
equation which the function f(x, t)- most Isatisfy, We x^ll then solve the partial 

differential equation and from the solution obtain p^(t)* . . - 

. ' - ^ N . - _ 

Multiplying (3.3) by x and summirig from 1 to » . . 

t |2n ^ ^ N-2 ^ ^ J (^^^j _ ^ f Np^ 

N=l N=l ■ . . ^ ■ N=l >N=1 • . . 

Adding (3..4) to this last eqilation - " = ^ ^ - ^ 



CD 



N=0 '- «,.• N=l . - N=0 .- ^"^^ N=l " 

From (3.23) however > / _ '•^ . ' ^ ^ 5^ "1 



■ \ 
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3t dt 



N-O 



and 



(3.26) 



'^^ N-1 



N-1 



By changing Indices the latter eqixatlon may be expressed as 

(3.27) " II > i (N+D' ^^x^ 

N=0 \ ■ 



ox. 



When .N< = 1 then N -'^ 1 = 0 so the- last sum can be exteth^eci to N = 

N=l ? ■. ^ ■ . ■ 

• ■ . ■ ■ ■ " ■ 

Using (3.25^ through (3.28) 111,(3.24) ^ - / : 



N-2 



3"f 



: 3t . ^ 



= (X x2 + y - {A + u}^x) 



_3f_ 
3x 



V . or 



-(3.:^9) 



This iS' the pai^al differential equation which f (x/ t) .'must' satisfy 
(3.23) becomes^ . \ , / , ' 



i 00 



N 



f ■ ' ' '■ ■ ■■■■■ "s^- 

Using the initial conditions (3.5) and (3;6) 



it ' 






y one\pf 



>baBility of 



i 
4 




1^ 
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? 



II =. (X - 1) {[(ai bi) X - Cai +.b2)] HT-Vbi x + h^) 




The^^eiiution of ,(3.29) with initial condition (3.30) can be obtained by applying 
the "inethba of characteirfrs^ics" , which is the standard technique of solving first or^er 
partial differential equation^. However, once- again, important inf drmation can be . . 
obtained without flolv;ing the equation. Rather we simply exaMne' the differential 
equation <3*29) itself. We shall, in fact, be able to derive the single most 
important fact about our stochastic mo^^l in this way — the *long run probability 
of extinction, lim Po(t) , which we denote by Po(~) • First we note that from 
(3.23), Po(t) = f(o, t) , thus ► 

J- 

(3.31) - P0<°") = lim f(x, t) , 

') ■ • ■ 

Next recall that in the model - , ' 

'* ~ ^ ' ' " ' 

/- 

' . ^ = bN(N - l/B) ^ ' „ . - - - 

•dt ^' ' , - • 

V* . ' ' , ^' - 

of Chapter II, the values "l\= 0 and N = A/B (the zeroes of the right hand side) ^ , 

played a crucial role. Now examine (3-29). the values 1 and x = y/X are 

^' ^ 3f 

clearly crucial ones. In fact,^or these ,twb values of^ x , we see that = 0 . 

That is f does not vary in t:ime>^hen x* takes on either value so - 

f;^^ tf = -/constant , " f(y/A, t) constant . 

We: use the initial condition (3.30) "to 'f i»d these constant's, thus 

/ . " ^ 

(^•32) _ fCl* t) = 1 ,^ f(uA, t) = (y/X)^ 



5^. 



for all values of t . ' X . ' , 

Now if there is to be an equilibrium -distribution as t » , then ^ f must 
settle down and stop changing as t"^ «? . Thu^ we assume that 

■ J- ' ■ ■ \ 
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Let' iim f (x^, t) = P(x) , then using (3.31) the quantity, - Po(~) y which we seek 
^ Is given by ' ^ r -v^. 

_ ' ' ^ \ Po(«) =>(0) ; , ^ 

' r?om^ (3.32) know that 

* t <r - . 



• / - 



A 



F(l) - lim .f(l, t) = 1, and^F(:^/X) ^ lim f(y/X, t) = (y/X) 

Moreover from (3.33) and the diffeti^tiarl -equation (3-29) we find 

X(x-y/X) (X - D ^^^l^ = 0 . \ ' . 

Hence F(x) -is a constant except possibly at x = 1 , x = y/X where it might jump:. 

Case^ 1^ y > X _] j j ^ k - 

V \ ^ ^ ' ^ 0 - 1 y/X. 




^ Since F(x) = con&tant for 0 j<^x < 1 , and since F(l) =1 , we have 

^ . .* L- . 

. * F(2g^ ^ 1 ,^ 0 < X £ 1 . 

Thus ' ' ^ - ^ ' i- 

(3.34) ' • p,o(") = I'(O) = 1 , ■ - y X . 

Extinction is- certain in this case. This result is intuitively reasonable for 

y. > X ,,bwt is soT^^at startling for ^iy"= X (in which case the ejipected value is ' I ).. 

Case 2. y X •" , j p_ ^ ^ ^ ' . 

■ • ■ -^0 . y/X 1 ' 



f We halve F*(x)"= 0. for 0 <_ x. < y/X , hence as above,. F(x)i' = constant for 



We are assuming contitiuity from the left at x = 1^. This can be established by 
noting that since the p^'s are probab;Liities , 0 <_ p^ , and - 

\ P-n- ~ ^ using some'' standard jresults of analysis. 
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Q. £ x < U/A . Since F(p/A) » (uA) , we conclude, as in Case 1, that 



F(0) - Cy/A> T^^so 



(3.35) 



for u < A 



Thus even when the birtH rate is higher than the death rate, the probability of 

extinction, in the long.rtm, is positive. ^ , . . 

* • ^ 

J . For those, who^are equipped with the nece^arjr prerequisites, we conclude 
' this section by s?(^ing (3.2-9) by a special ver^i6n of the method of ^characteristics. 
Consider f as a ftmction o£ a single parameter s and let 

dx 



\ (3.36) . 

"(3.37) 

' and * i 

(3.38) ^ 

(3.39) 

By the chain rtile then 



, = -X(x'- u/X)(x^ 1) - 
x(0) = C 



dt 



= 1 



4^ 

t;(0) = 0 



^df ' ^ -;Sf .dx ^ 11 dt_ 
ds 3x d^ • at ds 



From (3.36) J (3.39) and (3.29) 



^ (3.40) . 



(3.41) 



ds 



f(0) = ^ 



See previous footnote. 
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Now (3.40) is the partial differential equation (3.29) and Jthe initial condition 
(3,41) is the Initial fondition (3-30). Therefore, if we can find a salution x(s, O 
to (3,36) and (3.37); then we can easily integrate (3-38) to repG^ace s by t , and 
then integrate (3.40) to i^place ^ by f . Thus having x(t, f) .we can*invert 
this function to find f(x, t) . , With this in mind we p^ceed to integrate (3.36).* 



The solution of (3.36) using partial fractions is 



y Xx - y / 



X - y 

Using (3. 37 >-To' determine Ki " , . 

:j , ' cv-)s=^iog(,^^ ^) -■ . 

or , " ■ 

(g - 1) ( X - y) _ ^(X - y)s 
^^'"^^^ • ^ (XC - y) (X - 1) - ^ 

, From (3.38) and (3.34) ^ , 



S',,^t 

Using this in (3^2) and solving for C ->4^vaij!unction i?f x- and ^t 

^ . x(ye^^r-v)tr_ _,(JA-^u>t 

^ \ \~ Xx(e(V-^^ -1) - (-Xe^^ --.^^ -y) • 



4 



-Now the solution of" (3.40)^is - 



But from (3.41) 



f = 



SO 



■1:02 
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From (3.43) then 



■r. 



(3.44) 



f(x, t) 



pills la. the solution Qf (3.29) vith the initial condition (3. 30)* as may be verified 



by substitution. 



irooi^ (3."23) then pj(t) is the coefficient of in (3.44> . In particular 



the probability of extinqtion (zero, population) is Po(t) which is the coefficient '\ 



of xO in (3-44). Thus 



(3.45) 



i 



P (t) = ■ 



^(e<^^ - ^>^' - 1) 
Xe^^ - - U 



-1 I 



We will consider three cases:, X > u ; X < v and X = v • 



{ 



For X > u (birth rate exceeds .death rate) 



(3.46) 



lim- Po (t) 
t-xx> 



.(+) 



which ~ls in a^eement with (3.35). 



For u .> X -(death rate exceeds birth rate), we again fiyid 



(3.47) 



lim 



Po(t) = 



which aglrees with the previous result (3 . 34) 



\ 



^ Finally for X = y (b^rth' rate and death rate are equaD^ the right hand sid^ of ■ ' 
■(3.45) is indeterminate. ^To evaluate Po(t) in this case we replace (3.36) by 



' (3.48) 



dx 

ds 



=i - X(x - 1) 



and repeat the steps above arriving a€.' 



(3.49) 



f(x, t) = [1 + 



X - 1 
1 - (x - l)t 



ERIC 



/■ 8-3.21 

J . ' - ■ * 



It follows that 




Po(t) = 



yyt + 1 y 



when X = y . Finally then 



(3.51) . lim Po(t) = 1 



With this as background we now turn to a computer simulation of this birth- 
death process. We will compute an estimate of the probability of extinction.)^ 



wll!^ u&e (3.45) or (3.50) to compute the theoretical probability. We will also usfe 
(3.A6), (3l47) "9^(3.51) to compute the limitijig value of this theoretical probability. 
We xrilll i^erf'compare the' three results forj Po(t) : computer simulation, theoretical 
result and the limiting value ^ as t ~ • ^ . • 

^ • _ . ./ - 

3.4 Monte Carlo Simulation 

/We now turn to a computer simulation of the stochastic birth-death process. We 

will use the simulation to estimate the probability of extinction for a given initial 

\ . 

population, given time and for given probabilities of birth and death. 

^' . ■ - 

The simulation proceeds as follows. First a maximum, time M , is specified. If 

the population remains alive for this ^length of time, it xrtll be" said to have 

- ' / • 

survived. If, on the other hand, the population is reduded to zero-^before a time 
of M has elapsed, the population becomes extinct. We xcrill examine identical 
populations over and over again and count the number which survive and the number which 
become extinct. The ratio of the number of extinctions to the total number of 
popiilations examined is an estimate of the probability of extinction. 
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To this end we generate a random number* unifor^y distributed between, 0 and 1. 

If this random number, R , is between 0 and XNAt , then a birth is declared, and 

N Is increased by one. If R is between XNAt and ANAt uNAt , a^fieath is declared, 

\ " . . 

and N is decreased by - 1 . If R. exceeds XNAt + yNAt , then neither a birth nor " 

a death occurs, and N is unchanged^^ In any case the total time elapsed, X , is 

incr^aented by At . ^ ' ^ 

At this point twO checks are made. (1) If the^otal time exceeds the time for- 
survival, M , a survival is recorded. The variable S records the nxjmber of ^ 
survivals, so S is increased ty on^. (2) If the population, N , has reached ^^^^ 
an extinction is recorded. The number of extinctions, E , is increased by one. ^» 

If neither of these checks are satisfied, we generate another random niimber, R ^ 



and proceeds before. Since each time we generate a random number we increase 'the 
time, X , eventi/ally either X > M or N = 0 . Thus the prcfcess must stop with 
either survival or extinction. ^ / \ 

; 

This entire procedure '^is repeated a ryumber of times, ^ T , and the ratio of the 
number of extinctions recorded, E , to T is used as an estimate of the probability)* 
of extinction. 

4 ' ■ 

There is one" technical problem yet. to be considered. The probabilities of birth 
and death, X and y , are specified as is the time interval At . It is possible, 
therefore, that the population could become so large that XNAt exceeds 1 . Thus 



R would always' be less than 'XNAt . • To prevent this from happeining^ we allow 
, to vary. In particular we choose 

At = ^ ■ - . 

wh&re N i^the population size, v^his allows us'^ to use the following criteria: 




* ' ^ 



The computer generates a sequence of pieudo-random numbers;^ i.e^^^^a sequence which 
••behaves" randomly in the sense that the sequence satisfies a set of statistical 
tests for randomness. ■ ^ 
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R < X \ implies a birth 

X £ R < X -f y implies a death 

X + y < ] \mplies no birth or death. 

As the population becomes large, the time increments decrease but never reach zero, 

A program to carry out this simulation and print the Monte Carlo estimate^of 
Po(M) is given In Figure 3.1. In thi% program: 

L = X = probability of a birth in a time At 

\ ( : 

' U = y = probability of a death in a time At . 
M = time required until a survival is declared. 



T = nii©ber of trials experiment is to be conducted (the larger T is, 
the better the estimate of pqCM)). 



> 



E = nimber of extinctions. 
S = number of starvivals. 
^ X = elapsed time at any given point in the calculation. 

p = population at any given point in the calculatljOn. 
R = random number between 0 and 1 • ] 

K = index which indicates number of trial being conducted (K, £ T) . 

At the same time as the Monte Carlo simulation is being carried out, we can 
calculate -po(i:) from (3 .'45) or (3.50) where t = M . To accomplish this we let 



and 



F = EXP(M*(L-U) 



El = (U*(F - 1)/(L* F - U)) + I 



t 



so 



El = po(M) 
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■If X - w then j 



• El - a*M/(L*M +1)) + T 

In either case the value of El . is printed as the "THEORETICAL" value.' . 

We also will calculate the probability po(t) as t ^ « . This is given 
by (3.46), (3.47) or (3.51) 
Then 



We let "LIMITING VALDE" be lim po(t) 

t-x» 



LIMITING VALUE = 



(U/L) + I 



U < L 
U > L 



\ 
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100 

200 

300 

400 

500 

600 . 

700 

^00 

900 

1000 

riq.0 

1200- 
1300 
1 400 
1500 
1 600 
1 700 
1800 : 
1900 
2000 
2100 
2200 
2300 
2400 
2500 
2600 
2700 
2800 
2900 
3000 
3100 
3200 
3300 
3400 
3500 
.3600 
3700 
3800 
3900 
4000 
4100 
4200 
4300 



PKIMT 

INPUT 

PRINT 

INPUT- 

PkINT 

INPUT 



STARTING KA;>JD0M 



UIKTH kATF!" 



O^ATH KATE" 



INITIAL P0PULATI0N" 



TIME HEUUIKED F3H SURVIVAL" 



T3TAL N3. dF TkIALS" 



"TYPE 

"TYPE 
L 

"TYPE 
U 

IF L*U<=1 THEN 1000 

PHINT "BIKTH KATE PLUS DEATH KATE EXCEEUS 1 
G3 T0 300 . * 

PRINT "TYPE 

INPUT I 

LET P=I 

PKINT ^'TYPE 

INPUT M 

LET X = 0 ' 

PKINT "tYPE 
•INPUTS 

■ IF L<=U THEN 2 100 " 
LET, E2=CU/L)T I 
G2^ T0 2200 
LET E2=4 
PRINT 

PRINT' "PK0BABILITY 0F 
PKINT "LIMITING VALUE' 
IF L=U THEN 2900 
LET F=EXPCM*CL-U ) ) 
LET E 1 = <U*<F- 1 )/<L*F-U) ) T I 

G3 73 3000 

LET E1 = <L.*M/<L*M+1 ) ) T 1 • 
PRINT, "THE3RETICAL"»E1 
LET E=0 

LET S=0 ' . 

F0R K=l T0 X 
IF P=0 THEN 4500 
LET X = X -Kl/P) 
LET R=RNDCQ) 
IF K<L THEN 4000^ 
IF R<L+U THEN 4200 
G0 T0 4300 
^LET P=P+1 
'G0 T0 4300 
LET P=P-1 
IF X>=M THEN 



EXriNCT10N" 
•*E2 



4700 



4400 G0— T3 3400 



4500 
4600 
4 700 
4S00 
4900 
5000 
5100 
5200 
5300 
5400 
5500 



LET E = E-H 
G3 T0 4800 
LET S=S+1 
LET P=I 
LET X = 0 
NEXT K 

PRINT VM0NTE C ARL0"* E/ C E+S ) 
eRiNT 

PRINT "EXTINCTI0NS"*E*"SURVIVALS"»S 

G0 T0 100 

END 



FIGURE 3.1 
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/ Suppose^e\ start with X = y = 1/2. , ^an; initial jpopul^ation of 20 , and require 

: ^^rvlval foV a: time of 100 in-order for survival to be. declared. We will' ^^P^t; the. 
' atinulation SP ' times and estimate tbe probability o5 -Extinction. Thfe results axer ^/ 



4. 



TYP5 STAj^TING HANO0M N^.- 
?#?* * ' 

•-451: • * " ' . . ' r 

TYPE Blf<TH RATE ' * - 

type; deat^ rate- • 

" ? • 5~ ■ . . • \ - •. ' - " ' ■ * 

TYPE /fNI^TlAL PaPtlLATiaN' • ' ' 

TYPE -TIME- REQlJIi<E^>^98^ SUiiVI VAL , 

TYPE T;3TAL N0.-^ 0F TRIALS . 
?50' 

Pri38ABILITY^0F EXT1.VCTI.0N 
LIMITING V/iLUE 1 \ ' ' 

THEORETICAL .67297133307 
MaNTE CARL3 0.^66 



"\- 



EXTINCTiaNS 



33 



SURVIVALS 



17 



Notice that the Monte Carlo result is quite close to pg as calculated from (3.50) 
— see THEORETICAL . We now repeat the experiment for a longer time, perioi. ,^ Ins: ... 
Particular we require 200 time intervals for survival. The results are r 



TYPE STAKTIMG rcAND0M N0 . 

? # ? ' 

.451 

TYPE BIHTH KATE 

TYPE DEATH RATE 
?.5 

TYPE INITIAL P0PULATI3>J 
?20 

TYPE TIME RETQUIRED F0R SURVIVAL 
?200 , 

TYPE T0TAL N0 • 3r TRIALS 

?50 ^ 

PK0BABiLITY 0F EXTINCTI0N 
LIMITING VALUE 1 
THE0RETICAL • 8 I 954447028 

M0iNTE CARL0 - 0*8 



EXTINCT I 0NS 



40 



SURVIVALS 



10 
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Once again the Mbnte Carlo result, is quite accurate. Notice also that the ^ ^ » 
THEORETICAL valiie is closer t© the LIMITING VALUE. . Siifce the total time,^ M , 
is larger, ve sh<^uld expect threse two results, (3.50) and (3.51), to Be closer » 
tpgetlxeTc ♦than they weffe in ttie first trial. . , i 
. " Nfext we try ^ X < u . In particular we let |\ = .4 . and u = ^ . If we start 
with a pop.ylation of 25 « and require lO'O time periods for survival, the results ^^e; 



TYPE^ STARTIfJ;G ,RA?*D0M N0 

•5 ■ ' , ' ■ ■ ' " ■ 
TYPEt B-IRTH" KATE - ' 



^TYP'eT DEATH ^TE / 
:- TYPE INITIAL P0PULAT10>i . 

TYPE T^^5E REyJjVED F3K SURVIVAL 

?'ioo . / 

• TYPE T0TAU ;«<0.-. -^-i TRIALS 

?50 _ , 

^ ' 't •■ 

PR0BABrLITY^r^ EXTINCTION ~ 

L1MITI>JG VALUE 1 

THE0RETie^L .99999998286 

M0NTE G^KL3 U 

KX'L^CT.I3>JS 50 SURVIVALS 



Soitewhat surprisingly, all. three probabilities are 1 . ' 

With these same birth and death rates, we start with a larger initial popiilation- 
(50). but require only '50 time periods for survival.' The results are: 



TYPE STARTING RAND0M M0. " . * i ■ 



TY.PE BI{<TH hlATE 

T-YPE DEATH- t? ATE ^ ' 

?»6 \ ■ ■ ■ . . ^ 

TYPE INI TI\aL population' , . - . V 

TYPE T I Mte^ REQUIRED FOR SURVIVAL 
' • ?50 

TYPE T3TAL N9. 3F TRIALS ' . . ' , 

- - ■ ?5o , . ; - . - ^ - 

■ . . ^' ■ ■ .- . ^ • 

PR3BABtLIT^ 0F EXtl.MCTI3N " • ' 

LIMITI4J*G VALUE_ 1 . - n , 

THEORETICAL • §>99243592 1 8 , . ' ' .'^ ' * 

M3NTE CARLa 1 

' • . " . » . ■" 

EXTIiMCTI'aNS 50 SURVIVALS ' 0 

A^aln the Monte Carlo results are quite good. 

- -Finally we try X > y . We let X = .501 and y = ."499 . rne results are^^ 
■ XyPE STARTING KAND0M iNJO* 

- ■•5 .- - • . ■ ' . \-. : . -V 

TYPE BIRTH' RATE . " ■ \ 

?i501 . - . ^ ^ ^ 
• ' TYPE, DEATH , RATE " " 

^ TYPE INITIAL Pi3PULATI0N 

-20 ■ > 

TYPE TIME RE6>UIRED FQR SURVIVAL 
? 100 

TYPE TOTAL N0. OF TRIALS ' ' 

?50 - ' • 

• - . PROBABILITY OF EXTINCTION • • ^ 

' LIMITING VALUE 0.9231162479 " . 

''l THEORETICAL .6457 1382048.- - • " ^ 

■, >-MONJE CARLO ■ " 0.^64 - - . 

, ■ • ■ ' 

E'XTINCTI3NS 32 SURVIVALS 18 

One note of caution. Monte Carlo simulations can consume an . inordinate 

amount of computer time.. They should 'be used only as a last resort. In general if 
there is any way other than ibfonte Carlo to solve a problem, use the other way. 

In particular for this' birth-death simulation, one should beware of increasing 
either t^ time required for survival on the total number of trials beyond those used 
iTi^^tife«-^ove examples. I . 
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8-3.29 




CHAPTER III 

AUTHORS' EVALUATION 
(Please/^ citcle one of the responses to each question) 



Did yoji^ttend the short course in 1974-75? 
Is /this chapteif 

• (a)^- Too short 
(b) Too long 



- , Yes 



No 



(c) About ri^ht 
If (a) , which topics should 



1 - 




lexpanded? 



If (b) , which topicfs should be abbreviated? 



which topics should^ be eliminated? 



3,. Could you read and understand the computer programs? 



4. 



5- 
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(a) always . ' 
C (b) sometimes 
Did the interim projects seem reasonable? 
Were the self-study- problems 

^ \ (a) Too easy ^ 
Was the -numl>er of s^f-study problems 

(a) Too large . 

(b) A^out right 

■\ ' , 

(c) - Too small ^ l 



(c) seldom 

(d) never 



tes 



(b) Too difficult 

r ' ■ . 



No 
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7. Did you atteii5)t any of the self-study problems? Yes No 

8» Are the solutions to the self-study problems properly 

placed (on overleaf from problem)?^ Yes No 

If no, where woxild you suggest the solutions be placed? 



For each topic, how solid an understanding do you think you have? 

A: Excellent Good ' Fair Poor 

%■ ■ . . \ 

Stochastic model of birth-death 

, process ^ -* ' 1- 

Differential difference equation 

formulation _ 

Method of characteristics for 
solving partial differential 
equ^ions _ 

Honte Carlo simulations ■ ' - - '_ 

y * 
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' ' - - - ' « - 9 ' ' 

%• A PSEDATOR - PREY MODEL 

4^1 A Siim^le Model • * ^ 



Consider two species one of which preys upon the otter. For definiteness 



consider ^ foxes as the predator which preys upon pheasants. In the absence, of 
foxes the pheasants grow as described in Section. 1.1 (see eq« (1.2) )• That is ^ 

where is the pheasant populatioi^^ the end of the kth period. However, if 

foi^s are present they will retard the growth of the pheasants. We will assume that 
eacm'fox aSlfve at the start of the kth ^ period will consnme some pheasants. The 
more pheasants there are the easier 'it is for a fox to find- a pheasant on which to 
prey. Therefore, ^e assume that '-the number of pheasants consumed by ^any one fox is 



directly proportional to the number of pheasants alive^at the start of Cthe kth 
period. Based "bn these assumptions the ntunber of pheasants consumed by one fox 

A ■. ■ . ^ ; r. : ; ■ "■ ■ ■ 

is CPj£ . The total number of pheasants conBtmed^lJS^ F^^ foxes is CPj^F^^ where 
C > 0 . The constant! C depends upon the, search capability of the foxes and the * 
ground cover provided for the Ipheasants. If there is a large amount of foliage then 
the pheais ants 'can hide more easily and fewer are killed by foxes. Thus good ground^ 
cover reduces C . Similarly large values of C correspond' to poor ground cover. 



Foxes bom during the Jcth period are too young to be predators. 
This assumes that foxes do not prey lipon very youn~g pheasants or upon eggs. 

\> 8-4-1 ^ 



Equation (4.1) then bedcunes . - 

(4.2) ' . ■ P^^, ^ a ^ BP,)P, - CP^F 



- - ZA 



We now ttJrn our .attention to the foX pbpulatioi^.- We will let. 'E^^ be the 
number -of foxes alive at the start* of the kth period. Suppose pheasants provide 
' the 6ole food supply for the foxes, fliq. the absence of pheasants then the fox 

populatipti will vanish.' We will assunie' that if the^heasant papulation becomes _ 
zero, the fox population will die out in one period. I^hus ^ implies that 

I -tl^^ox population at the, end of the kth .period vanishes; i..e.., \+i ^ ^ • 
'^v/will also assume that the fox population at the end of ' a period is directly 

proportional to, the population at the beginning of the period. These two assumption 
lead to " . - 

(4.3) ■ — = 0P^\_ - . ■ 



where D > 0 and represents the rate at which f 03^es* convert their food supply, into 
poptilation growth. If the food conversion process is, efficient, then D is large. 

^ ^ ' , O 

4.2 Equilibrium and Stability ;> ^ • ^ 

Be^fore carrying out some numei^cal experiments we tu:m .to a discussion of 

equilibrixim populations and ttie s^^bility of ^ these equilibrium populations. 

- ■ \ 

^ Will^ the pheasant "and - fox popxjlations. reach equilibrium? 

- If we wish to ins^ute predator, control (kill foxes) , when should we do so, 
and -how many preadators should be eliminated. 

-> ■ , • 

If we. wish to allow pheasants to be hunted , when should we do so, and how many- 
pheasants should we allow to be killed? - ' * 

" ^ What would be-ajie effect.' of peifiodically adding more pheasants to the popiilatioi 
' We will attempt ii whatT follows and. in the exercises to answer these questions. 
"* The "reader is once again urged to think of other similar questions which might be of 
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intierest to him or to ecologists and^o use mathemat^-cs and/or computing to search \ 
. for the answers, following shotild provide a guide for such answer-seeking 

' We first determine what the e^llibrixm/pppulations are. If both pheasants 
and foxes are to reach eqxiilibrium then for k -sufficiently large .both 

. ' P = P = P 



and 



k+1 k ^* 

' . ^ / . ' ' \ - 

where P^ . and are the ^quilibriim populations. Using these in (4.2) and (4.3) 

.4) ^ - = (1 + A - BP^)P^ - C F^P^ 

(4.5) . ^ ^ F^=^DP^F^ 

'These are two algebraic equations in two unknowns P^ anc 
From (4,5) eitl^er 

r ■ ■ 

or.' ■ ' '\ ^ ; . ., ' ' • 

y » . . P* = 1/D " - » ' 

' ■ ' * \ 

« V ' • * 

* ^ . ' / , • > 

<;onsider first = ,0 then (4.4) becomes 

. . P* = (W A -,BP^) p/ 

■. ^ • ■ , • 

this is the same equilibrium equation we met in the single species model. ^ Our 

earlier analysis then tells us there are two solutions : = 0 or = A/B . 

We have then found two equilibrium conditions. Either * . ^ 
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. .. • ..r, 

(4.6) - . and 



^ 5'* = 9 



or 



(4.7) and 



A ' = 0 



= A/B 



There is, of course, still the case where P. to be considered/^ In this 



cas€^ (4.4) "leads to * ^ * 



1 



^ AD ^ B. 
* DC 



A third equflibrlAim condition then is ^ 

••/''' . •■ ■ V 

V -F = AD - B • 

,^85^ and: . . * ' 



1/D 



The first condition, where both populations vanish', is riot- of much interest, 
- " • -. /•■ . ■ ■ - , . ■ ^ 

but we"' shall investigate the other two. . For eaSe of ^reference we will define ' 



, (4.9) * . ^ ■ = A/B 

. ^-4.10) • , P = l/D 

(4 11) ' " " F AD_^ - -. : 

^ H.;^ - e\ DC 

The two equilibrium conditions then are (i) 0 foxes and . pheasants, and (ii) 

F foxes and P • pheasants. The subscrit)ts E and e derive from the" word' 
e ^ e ^ . . 

"equilibrium". As we shall see, '"the lower case ^e refers to a lower value of the 
pheasant population than does the upper case E • 

To investigate the stability of these equilibrium conditions and, in more general 
terms, the beliavior of the fox and pheasant populations, we will turn to a computer 

ERIC ... ii? ■ 
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program and some numerical experiments. In order tq^do so, however, we would need 
l;p' assign values of A , B , C and D . /It is unlikely that we could obtain the 
values of all of these parameters even^ere we to ask an experienced ecologist- On 
the other hand, an ecologist might be able to estimate the values, of Pg , P^ . and F^, 
For example, ' P„ is just t the number oife pheasants which the environment can support 
if no foxes are present/ Similarly' P^ and are the numbers of pheasants and 

foxes which would be present, in a completely balanced situation. 

'Could we compute A , B , C and D if we were given £}Je values of P^ , 

and F ? The answer , xm fortunately , is no* Recall that in the single species 

: e , . ■ " ^ ■ - 

problem we could nop compute both A and -B from^N^ . However, from and' A 

we could compute B . That is to say, we needed one of xhe original parameters in 
addition to the equilibrium population. The same is true here in the predator-prey 
problem. Given values of the equilibrium populations and the value of say A , we 
can compute all of the other parameters* Indeed, (4* 9), (4.10) and (4.11) can be 
solved to obtain 



(4.12) . B = ^ 



(4.13) , C = ^ffF 



E e 



(4.14) - D = I 

We have assumed that none .of P , P ^ or F are zero. Moreover, since our original 

ill e e - 

equations assumed that B , C and D are positive, it follows that ^ "^e ' i*^*^ * 

the pheasant equilibrium in the absence of foxes is larger than the pheasant equilibrium 
population if foxes are present. 

We now construct a comptTter program which takes P^ , P^ ^ F^ and A as input. 
(A 'is the unrestricted pheasant growth rate). The program computes B , C and D 



then asks for starting pheasant, and fox populations an* for the nximber of periods to be 

11 
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predicted. .. The program is shown in Figure 4.1. It should be self explanatory^ 
excepfr-i>erhaps for the statements numbered 2400 and 2600.- Each of those checks to 
see if one. of the two species has dropped below 1^. If so that population is set - 
eqtial to zero. Numerically, of course, we could obtain negative values for the ^ 
populations. In the single species case this was pf little concern since we merely 
assumed, after the fa^J^that negative values meant zero populations. In this two 
speciek case, however, if the fox population became negative it would affect the ':; 
pheas-ant population in an unnatural way." Therefore, it is crucial that we prevent, 
negative populations- Finally we note that it may seem more natural to set a 
populatioii^qual to zero if its value drops below 2 or even some lirger number. 
Our choice of 1 is somewhat arbitrary and^-pot^ be changed without affecting the 
general ^ehavior of the populations,. ^ 

0100 PtilMT -TYPE PHEASANT EuUiLIBKIU« P3PJLATI3.M IN ABSENCE 3F FiXES" 
0300 JkINT "TYPE PHEASANT EQUILIBRIUM P3PULATI0N «ITH F3XES PRESENT" 

0400 INPUT P2 ^ A-rTr;,^" 

' 0500 PRINT "T'^PE F0X EC^W I LIBRIUM PAPULATION 

0?00 PRIN? "?Y^PHEASANT UN-KESTR I CTED GR0WTH RATE" , 

0800 INPUT Ax 

0900 LET B=A/Pl ' 

1000 LET C=A*<Pl"-P2)/CPl+F2r 

1200 1^RINt'"TYPE INITIAL PHEASANT P3PJLATI0N" 

1300 'INPUT P , .. ■ 

1400 PRINT "TYPE INITIAL F0A P3PULATI0N 

1500 INPUT F ..■ . r- -> Tr-TC-,^.. 

1600 PRINT "TYPE N3. 0F PERI30S T0 . bb. KREOICTEO 

• 1 700 INPUT N ' ' -S^. 
1800 PRINT " 

1900 PRINT "PERI3u">"PriEASANTS":."F0?^E:3 

2000 «F i3k 1=0 T3 N . 

2100 PRINT IjPjF • • 

2200 LF.T P.3 = C 1+A-B*P)*P':U*F*P 

• 2300 F3 = D*P*F 

2400 IF P3>1 THEN 2600 

2500 LET P3=0 

2600 IF F3>1 THEN 2800 

^2700 LET F3=0 

2800 LET P=P3 

2y00 LET F=F3 • . 

3000 NEXT I ' ' • ' 

3100 ENO ll j p.g^^3 4.1 , 
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We now use this program and examine some specific examples. One case is 
exhibited in Figure 4.2. The pheasant and fox populations are started Relatively 
, close to the equ;l.librium values. In particular the initial number of pheasaitts 
(9,000)* is somewhat less than the equilibrium value (10,000), aad the initial 
number of foxes^ (1,100) is somewhat larger than the equilibrium value (1,000). 
In each case the difference between the initial population and the eqiiilibrium 
population is 10%. 

Notice that for all practical purposes each 20 periods the populations return 
to the same values. In order to study these results more carefully we draw a graph 
of the populations. We could,* of course, p^ot each of the populations of the two 
species as functions of time (number of periods). However, we will find it more 
useful to plot the number of foxes as a function of the number of ' pheasants . The 
graph is shown in Figure 4.3. The initial point is indicated by the large circle. 

V 

The arrows indicate the order in which the p*bints appear as time progresses. The 

equilibrium solution F^ = 1,000 and = 10,0<J^ is indicated by the large X . 

From the cyclical nature of this behavior it appears that the equilibrium 

and F is xmstable. Indeed this is the case. 

e -* . 

Let us now try another example as shown in Figure 4.4. Notice that in this 
case even though the foxes start at twice the equilibrium value, the pheasant 
population is insufficient to sustain the. foxes and the latter become extinct rather 
quickly. Thereafter, the pheasant population continues to thrive and should eventually 
reach 10,000. ^ 

We could continue such numerical experiments, but we shall not do so here. 
Rather we turn our attention to a discussion of hunting seasons, and predator control. 

Self-Study: Problem #4.1 

Assume that the growth of the pheasant population is not affected by over- 
crowding. Simplify the model discussed above accordingly and discuss the equilibrium 
and stability question. 
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TYPE PHEASANT EQUILIBRIUM POPULATION IN ABSENCE OF FOXES 
720000 

TYPE PHEASANT EQUILIBRIUM POPULATION WITH FOXES PRESENT 
710000 

TYPE FOX EQUILIBRIUM POPULATION 
71000 

TYPE PHEASANT UNRESTRICTED GROWTH RATE' 
7-2 <- 
TYPE INITIAL PHEASANT POPULATION 
'79000 

TYPE INITIAL FOX POPULATION 
71100 

TYPE NO. OF PERIODS TO BE PREDICTED 
740 



y 
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PERIOD 


PHEASANTS 


FOXES 


" 0 


" 9000 


1 100 


1 


9000. 


990. 


2 


909.9. 


' 891. 


3 


9280.17 


810.722 


A 


9522.62 


752.363 


S 


9803.9 " 
1 0 lr0 f*. 1 


716.447 


6 


702.397 


7 


10391.5 


709.5 


8 


10652.7 


737.278 


9- 


10863. 


785-4 


10 


1 1002.4 


853.184 


11 


1 1053'. 7 


938.708 


12 


11004.9 


1037.62 


13 


10853. 


1141.89 


14 


10606.4 


1239.29 


is 


10288.3 


1314.44 


16 


9935. 12 


1352.33- 


17 


9591.52 


1343.55 


18 


. 9301. 18 


1288.67 


19 


9097. 68 


1198.62 


20 ■ 


8999.08 


1090.46 


21 


9007.74 


981.318 


22 


9113. 95 


883.945 


23 


9300.47, 


805.623 


24 


9546.31 


749.268 


25 


9828.98 


715.274 


26 


10125.7 


703.042 


27 


. 10413.6 


711.876 


28 


10670.6 


741.32' 


29 


10875.1 


791 .032 


30 


11007. 2 


860.252 


31 


11050.1 


946.892 


32 


10992.8 


1046.33 


33 


10832.7 


1150.2 


34 


10579.8 


1245.98 


35 


10258.2 


1318.22 


36 ' 


9905.29 


1352.26 


37 


9565.74 


1339.45 


38 


9282.57 


1281.28 


39 , 


9088.07 


1 189.36 


40 ^ 


8998.85 


1080.9 



Figure A* 2 
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TYPE' PHEASiWaT EQUILIBRIUM POPULATION Ii^ ABSEiVCE OF FOXES 
T10000 

TYP^: PHEASANT EQUILIBRIUM POPULATION WITH FOXES PRESENT 
?5000 

TYPE FOX EQUILIBRIUM POPULATION 
?1000 I 

TYPE PHEASANT UNRESTRICTED GROWTH RATE 
?.l - 
TYPE INITIAL PHEASANT POPULATION 
?1000 

TYPE INITIAL FOX POPULATION 
72000 

TYPE NO- OF PERIODS TO BE PREDICTED ' 
?20 



PERIOD 


PHEASANTS 


FOXES 


0 


1000 


2000 


I 


990 


^ 400* 


2- 


1059.4 


79.2 


3 


1149.92 


16.7809 


4 


1250.72 


3*85933 


5 


1359.91 


0 


6 


1477.41 


0 


7 


1603*32 


0 


8 " 


1737.95 


0 


9 


1881 .54 


0. 


10 


2034.29 


0 


U 


2196.34 


0 


12 


2367.73 


=: 0 • • 


13 • 


2548.44 


0 - 


14 


, 2738.34 


0 


15 


2937.19 


0 


16 


3144.64 


0 


17 


3360.21 


0 


18 


3583.32- 


0 


19 


3813*25 


0 • 


20 


4049*17 


0 



r 




Figure 4.4 
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Solutlofg to Self-Study; Problem #4.1 ■" 

— ■ '• ■ - .. ■ X 

If crowding is neglected then B = Then the model becomes 

- . ' tap 

Letting and be the equilibrium populations 

(A - C F . ) = 0 • , ji, 

V, The eqtiilibria are . * 

F = ^ P = i - - . ' ' 

. • * C ' * D . 

;'■ ^ . , - C 

^ The stability of these equilibria can be investigated either by means 

of a computer program sibilar to that of' Figure 4.1 or by techniques similar 
to those employed in Part I of these notes. The changes . required in Figure 4.1 
are ' C 

100 

' -^00 

• 900 LET- B.= Oi 

^. ^ 1000 LET ' C = A/F2 V 

The equilibrium F^ = 0 , P^ = 0 is easily seen to be unstable. For ±f 

we consider .the starting values Fq = 0 , Pq arbitrary, we find F, = 0*, 

k " ■ ' ' 

Pj^ = (1 + A) Pq • ^ (See e.g. • Section 1.1 of the appendix). 

Thus no matter how small Pq is , as long as Pq and . A are positive, Pq ^ 
To investigate F^ ^ A/C - , P^ = l/D , we set 

= f, + A/C , P, = p, + 1/D 
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and drop terms in. f, pj^ . On el±minatitig f from the resulting equations 



k 

we find 



The second order difference equation may be solved using the techniques 
described in Section 2.2 of the appendix. , The solution for Pj^ is 

p = a(l + A)^'^^ cos(k -8 + B) ' 



where 



^ -1 i^TVT 
e = TT - cos ■ ^TTT 



arid where a and " are constants determined by the initial values po 
and fo . The solution oscillates and the amplitude increases if A > 0 
Therefore the equilibrium is unstable. 



^iSelf -Study; Problem # 4;2 

C<&slder weakening the assumption that in the absence of pheasants at period 
k , the foxes are extinct at. period k + 1 to the assimption that in the absence 
of pheasants, the foxes obey a siii5>le (negative) growth law. Find the equilibrium 
populations using this new assuii?>tion and modify the. program in Figure 4.1 in order 
"^o stbdy the stability of the equilibria. Check your resxats by noting that the , 
model discussed in the text is a special case of this one, s 
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Solution to Self-Studj^ Problem #4>2^ 
In the absence of pheasants 

. ■ .c^ . ' • ■ • 

\+l -\ = -^Tk ' .0 < Gil 

. \ 

Thus, the full model is ^ 

k+1 k k k k k 

■ . k+i k , k , . k k 

NtJte that C = 1 gives -the model discussed in theN^text. The equilibrium 
population^ are . 
(a) F = a and P = 0 



of 



or 



Thus 



(b) F^;= 0 and P^ =' A/B 



r \ 't^ ad - BG , G 

^e= -CD— D 



B = A/P^ 



C = ACPy - P^) 



-^e 



Notice' that the first two of these are identical with (4*12) and (4.13) and 

^-^\ ^- " ' ' 

that-^ the last reduces to (4\14) for G = 1 . ' 

The only changes 'required in the BASIC program in Figure 4.1 are- 

. • . , ' ' ,' 820 PRINT "TYPE TOX tJNRESTRICTED "DEATH RATE" 

' - '830 INPUT G ' ' • . 

1100' LET D =-G/P2 ' - 

2300 LET F3 = (1-G)* F + D*P*F . . ^ 

ERJC ■ 123 
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•4.2 Predator Control 



We continue our study of pheasants and foxes, and assume the two populations are 
governed by (4*3) and (4 ♦4). We will consider the particular: example shown graphically 
in Figure 4*3 although our discussion is applicable to more general cases as well. 

Suppose that a decision has been made to institute predator control ♦ Such 
a decision might result from one 01: several of the following policies: ^ IS^- 

(1) The pheasant population should be kept above some minimum Tj^ue, 

say 10,000. . . - . 

{2) The fox population slioiild be kept below some ma-g-ftrnTm value, say 
1,200. 

(35 It is desirable to allow foxes to be hunted and killed. 

V 

As has been our habit , we ask the reader to try to think of other policies which 
might lead to a decision to Institute predator control* Moreover, we encourage the 
reader to think of more fxmdamental problems which might in turn give rise to the 
above policies. By way of example, it may be that if the fox poptilation exceeds . 
1,200; the animals are so numerous that they create a nuisance to the human Inhabitants 
and thus policy (2) ±^ Instituted. * ' ^ 

Be that as it may, we now- try to decide upon a sensible way of implementing 
predator control without upsetting the ecological balance. Our first inclinati^on 
would be to kill foxe$ when the fox poptilation was relatively high. Thus we look 
towards" the upper part of the graph in Figinre 4.3. ' As a start, suppose we decided ' 
to kill foxes at the end of period 18 when there are approximately 9,300 pheasants- 
and 1,290 foxes. We will assume that the control season (time during which foxes 
are killed) is quite short compared with the time periods in pur computations. Thus 
when we kill foxes, the pheasant population remains unchanged. This means that on 
our graph (Figure 4.3) we wbuld travel downward on a vertical line from period 18. 
If we then abandon predator control the two popxalations wotild continue around the,: 

-^^0 ■ ■ . 
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oval as before". The result would be the pattern indicated in Figure 4.5(a). This 

-A )■ ' ■ Y ■ ■ ■ 

assumes, of course, that tWj^ predator control is reins tixuted each time we reach . 
9,300 pheasants and 1,290 foxes. - ^ 




Figure 4.5 



PI. 




Rather than use control at period 18, suppose we.?ld.ll foxes at. the close of 
period 14 where tHl pheasant population is 10,600 and the fox population is 1,240. 



Once again we travel vertically downward and then resume the oval. The result is 
shown in Figure 4.5 (b) * ^ . .! ^ 

Let us now exaininfe these two alternatives and make som^ IbbserVations. The . first 
alternative has relatively lirt^le effect overall. Ttie pheasant and fox populations 
both vary between approximately the same limits. Therefore if our goal was to satisfy 
policy (3) above-, this might be a reasonable choice. The second choice which leads 
to Figure ^-^Cb), on the other hand,, has considerable effect. While the fox population 
still varies between widely separated values, th^ pheasant population changes, very ' 
litjtle. There is. yet another observation to be made. In Figure 4.5(a) the time 
between hunting seasons is about 15 periods since .we^ill drop from period 18 to 



! 
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perlo^d 3 conditions. In Figure 4.5(b), howfever, the time between hunting seasons is 
only 6 peirxods (period 14 to- period 8). 

What conclusions can we draw from these observations. The second course of 
action, the one in Figure 4,5(b), is betteip^ adapted to policy (1), i,e., keeps the 
pheasant population high. Neither solution does much for policy (2) since ^n both 
cases the fox population grows quite large. Even so, the Second alternative does 
keep the maximum fox population a little lower than does the , first choice. Finally 
if an objective is to have frequent hunting ^seasons on foxes then the "second choice 
is clearly preferable. On the other hand, if predator control is an expense, and we 
wish to use it as infrequently as possible^ then the first choice is the better one. 

On balance then the second choice as shown in Figure 4.5(b) seems a wise one, 
and we shall choose it. We will concentrate on policy (2) of keeping the fox 
population below 1,200. 3efore devising a detailed strategy of predator control, 
however, we reexamine the assumptions we have made* and discuss the consequences of 
any variations in these assuiaiptions. 

We assumed that the predator control season was quite small compared to the 
time periods in our calculations. This led to vertical lines in the graph. Suppose 
this is not so. As control^ is started in either of the cases in Figure 4.5 Che 
pheasant population is decreasing. Therefore, the populations would follow a line, 
perhaps with slight curvature, down but slightly to the left.. One possible patteiti 
is shown in Figure 4.6(a). It corresponds to predator control at period 14, i.e., 
the s^ond course of action, 

A second assumption was that our control was so accurate that we killed 
precisely the number of foxes necessary to bring us back to our oval curve. This 
degree of presasicr q y quite unlikely, and we are more likely to overkill or underkill, 
In either case, provided we do not m^ss our target number by too much, we simply end 
on another similar shaped curve. The case of two successive overkills are shown in 
Figure 4.6(b) where the pattern movesVfrom left to right. Of course, upon observing 
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Figure 4^6 



such a pattern, it is likely that an adjustment to produce an underkill would be made 
for one or two hunting seasons. 

We now return to the details of our predator control and to the program in 
Figure 4.1. , We will change the program so that if the fox population exceeds 20%* 
of the equilibrium fox population*, the program will (a) ^ tell us what the two 
populations would be in the absence of control, (b) allow us to determine a number 
of foxes to "be killed, and (c) continue the computations with the same numbers of 
pheasants but a reduced number of foxes. ^ 

To accompfish this we add the program sfeps in Figure 4*7 to the BASIC program 
in Figure 4.1. ^ 

« ~ 2800 IF F3 < 1.2 * F2 THEN 2900 

2810 PRINT "PREDATOR CONTROL WITH NO CONTROL THERE WILL BE" 

. 2820 PRINT F3; "FOXES AND"' P3; "PHEASANTS" - 

2830 PRINT "HOW MANY FOXES SHOULD BE KILLED?" 

- ■ 2840 INPUT X . . ■ 

- 2850 LET F3 = F3 - X - - 

2950 LET P = P3 " ° ' ' ' ' 

Figure 4.7 



T-a this case this means if the fox population exceeds 1,200. 
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The first statement checks to see if F^^^ < 1.2 . If so we still bypass 
control even though the pheasant population is on the decline. Statement 2820 to 
2850 should be self explanatory. Statement 2950 is necessary since we deleted the , ' 
previous LET P = P3 by our new statement 2800. 

An ^ample of running this revised program is shown in Figure 4.8. Some 
explanation of this figure is in order. The first predator control is at^eriod 14. , 
Since there are 10606.4 pheasants we look back in time for a season with approximately 
the same number of pheasants. If we could find a period with precisely that number 
of pheasants, we would kill a number of foxes which would returp us to that state. • 
The best we can do, however^ is season 8 where there are 10652.7 pheasants. The 
fox population there is Fs = 737.278 . To reduce the fox population to this latter 
figure we would need to kill 502.0112 foxes. However,, since the pheasant pppulation 
at period 14 is slightly less than Ps , we choose to kill more than 502 foxes. In 
fact we kill 520. 

The second time that control is exerted is six periods later where ^P20. = 10707.3. 
This pheasant population is about midway between Pm and Pis so we kill a number 
of foxe^which will leave the fox population about midway between F^:^ and 'F15 . 
TJjis^eads to .a kill of 480 foxes. 

At period 26 we kill 530 foxes and arrive at populations slightly less than 
period 8 so that we are slightly inside the original oval. At period 32 we kill 
465 foxes to achieve populations slightly larger than period .8 so we ^ are slightly 
outside of the original oval. The remainder of the computer printout and the strategy 
used to achieve it should be self evident. 

Our strategy has been simple enough. At each point where the fox population 
exceeds. 1,200 we look back in histary for a state' in which the pheasant population 
is close to the present pheasant population. Upon finding such a state we make note 
of the fox population of that past state. We then kill enough foxes to bring the 
present fox population doyn to the lower value of the past state. Of course, we are 
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not able to find the precise pheasant population in any past season. Having chosen 
the nearest one, we make, some compensating adjustment in the fox kill. 



TYPE PHEASANT EQUILIBRIUM POPULATION IN ABSENCE OF FOXES 
?2000e 

TYPE PHEASANT EQUILIBRIUM .POPULATION VITH FOXES PRESENT 
710000 

TYPE FOX EQUILIBRIUM POPULATION 
7^0 I . 

TYPE PHEASANT UNRESTRICTED GROWTH, RATE- 
R'S •[ ' 
TYPE INITI^ PHEASANT POPULATION 

79000 / ' , , 

TYPE INITIAL FOX POPULATION . 
71 100 ^ 

TYPE NO. OF PEOTODS TO BE PREDICTED 
735 ♦ 

PERIOD PHEASANTS FOXES 

- 0 9000 .1 100 . 

1 9000. 990. 

2 . 9099. 891 . 

3 ' 9280.17 810.722 
A 9522.62 752.363 

5 9803.9 716.447 

6 10101.1 702.397 

7 10391.5 709.5 

8 10652.7 737.278 ? 

9 10863. • 7 85.4 • 

IjS 11002.4 . 853.184 ^ 

11 11^3.7 938.708 

12 t 11004.9 1037.62 

13 ^ 10853. 1 141 .89 



Pigure 4.8 
(Part 1) 



ID 



PREDATOR COiVTROL- VITH NO COiNTROL THERE U ILL BE 

1239.29 FOXES AiMD 10^06.4 - PHEASANTS 
HOW MANY FOXES SHOULD BE KILLED? 
7520 

14 \ ^ 10606.4 719.287 

15 10839.8 762.904 

16 11005.8 826.973 

17 11085.5 910.149 

18 11064.8 1008.95 
•19 10937.1 1116-38 

PREDATOR CONTROL. WITH NO CONTROL THERE WILL BE 

i220.99 FOXES AND 10707.3 PREASAiVTS 
HOW MANY FOXES . SHOULD BE KILLED? 
7480 

20 10707.3 ' • 740.993 

21 10908.9 793.404 

22 11035. 1 865.516. 

23 . 11069.3 -:..955.10l 

24 11000.6 *^ 1057.24" 

25 10827.6 1163.03 
PREDATOR CONTROL. WITH NO CONTROL THERE WILL BE 

1259.28 FOXES AND 10561.5 - PHEAS^ANTS 

HOW MANY FOXES SHOULD BE KILLED? 
7530 

26 10561.5 729.279 

27 10788.1 770.225 

28 10950.9 830.926 

29 11032. 909.943 

30 11017.5 - 1003.85 

31 10901.1 1105.98 
PREDATOR CONTROL. WITH NO CONTROL THERE WILL BE 

1205.65 FOXES A^D 10687.4 " PHEASANTS 
HOW MANY FOXES SHOULD BE KILLED? . 
?465 , ' ' 



Figure 4.8 
(Part 2) 
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Self -Study; Problem #4.3 • 

Devise other strategies for predator control and modify the BASIC program 
•iiuFigur:e 4.1' to implement that control. In particular, when the fox population 

is more than 20% above equilibrium reduce the fox population , to efluilibrium- 

' ' ■ ■ * • • V ■ ■ ^ • 




V 



/ 
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S;<>lttfcioa to Self-Study: Problem #4^3• 



\ -.v ' The required, modifications to ^Fi^gure 4.1 are 



2800 

.2'810' 

2820 

2830 

2840 

2950 



IF F3 < 1.2 * F2 THEN 2900 
PRINT "PREDATOR CONTROL" 
LET X =^ F3 - F2 
PRINT "KILL"; X- ; "FOXES" 
LET F3 = F2 . ' 

LET'P ='P3 



'4 



< 
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Self -Study; Problem #4.4 , 

, Referring back to Self-Study Problem #4,2 write down a pair of-^irst-order 

... ' •• V « . . - . 

differential equations wbich represent the continuous model for the pheasant-fox ^ 

p;cobleia, ■ ^ 



0 
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Soltttion to Self-Study; Problem 3^4.4 



. ■ 3r = (A - BP)P - CFP. 
-» at 



dt 



= - GF + DPF 



-, Notice that G = 1 no longer implies the model used in the text since 
this Q is At times the G in Self -Study Problem # ^-2. 



f 



s 
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CHAPTER IV 

AUTHORS' lyALUAtlON 
(Please circle one of the responses to each question) 



1» Did you attend the short course in 1974-75? 
2. >Is this chapter ' 

- ^ • <a) Too short 

- -f . ■ ■ 

(b) Too long ^ 
. (c) About right 

"fey ■ • 

If (a), which' topics should be expanded? 



Yes 



No 



can you suggest topics to be added? 



If ^4b^ ^- which topics should be^ abbreviated? 



T 



which topics should be eliminated? 



3* Could you read and understand the computer programs; 



' (a) always 

(b) sometimes 

4. 'Did, the interim projects seem -reasonable? 

5. Were the self -study problems 
^ (a) Too easy 

6. Was the number v of self-study problems. 

(a) Too large . 
• (b). About right 

i- 

(c) Too small 
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(c) seldom 

(d) never 



Yes 



No 



(b) Too difficult 



7* Did you ^attempt any of the Self-study problems? Yes No 

8* Are the solutions to ^ the "Self -study pfoblems properly 

plated (on overleaf from problem)? Yes No 

If no, where -would you suggest the solutions be placed?. ' 



For each topic, how solid an understanding do you think you have? . * 

Excellent Good ~ Fair Poor 

Pyclical Nature of population ^ ^ 

;: 

Predator Control Methods - " 

Effects of Over (Under) kill _____ 

Multiple Species Models in General ■ j ^ 
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CHAPTER V 



.AN ECONOMIC. MODEL 

5.1 A Simple Model 

Assume that the total national income, T , can be separated into three part's: 
constnBer expenditures, C ; private investment, I ; and government expenditures, G * 
Thus 

^ = C + I + G ^ 

Alll of these quantities vary witfh time. Usually the values of each of these are known 

only at specific, times the end of a year or the end of a quarter of a year. We 

will assume then that each of these four quantities is measured and known at fixed 

noints in time. Let T ' , C ,1 and G be the values .of the total income, 

^ , n p.^ n n 

constmer expenditures, private investment and government expenditures for the nth 
period where n = O, 1, 2, ... . Then 

■ ■ . - ^ <9 ..." - 

rs.i) T = C I + G^ 

^r* ^ n n n ^ ■ . .• 

■ . * . - ■ ■ . • ■ 

Next we assume that conveners' buying habits are affected favorably by the 

total national income. However, consumers only know the value of the national income 

for -the periods prior to the current one. We will assume that consumers have a short 

memory so their buying habits in the nth period are only affected by the total 

national income ^in the (n - l)'st period. Moreover, -we will asstime that C^ is some 

percentage (perhaps greater than 100%) of ^q.^ » l-^-» 

(5.2) . " ^n-l n-1, 2, 3,,.. 

• 8-5.1 • ■ 
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The constant of proportionality is called the marginat propensity to ^conszme*. We 
assinne that ' ^ 

• A > 0 . . , : • 

Next we assume that an increase in consumer spending will^ncrease investment of prixrate 
capital. We suppose that investment is pro^iortional to a change in consumer spending 
so that * i - 

(5.3) . I = B(C - C ) n = 1, 2, 3, ... 

. • .. n . n n-i 



We assume that 



B > 0: 



Finally we assume that government spending is constant 
(5.4) ' = 1 \ \ n = 0, 1, 2, 



n 



Using (5.2), (5.3) and (5.4) in (5.1) we , arrive at 

* ^ ■ ■ 

(5.5) T = A(l + B)T . - ABT » + 1 n = 2, 3, 4^ ... 
^ n • n-i n-2 

whicli^an be rewritten . 

(5.6) - A(l + B)T^^ + ABT^ =1 ^ /n - 0, 1, 2, ... 

Given Tq and Ti we can calculate^successively T2, T3 , Ti^* and so on. 

■ ■ ' "7/ ■ - • 

5.2 Numerical Solution 

~ ^ ^ ; . ' ^.■ • 

We will write a BASIC program which takes as input. A , B , Tq and Ti 
together with the final period to be predicted. If M is this final period then 
the program computes and prints T2, • * 

G ' 1*13 , ' • 
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The program is 



too PmiVT -TYPE VALUE FOR A*« 
800 INPUT A 

300 PRIMT -TYPE VALUE FOR B** 
400 INPUT B ^ 

500 PRINT -TYPE NATIONAL INCOME IN ZEROTH PERIOD- 
600 1»»UT TO > 
700 PRINT -TYPE NATIONAL INCOME IN FIRST PBRIOO- 
000 INPUT Tl ^ 

900 PRINT -TYPE FINAL PERIOD TO BE PREDICTED- 
1000 INPUT M 
1100 PRINT 

1200 PRINT -PERI0D-«'*9IATI0NAL INCOME- 
1300 FOR K « 2 TO H 
1400 LET T2 » A*C1*BJ*TI - A«B«TO ♦ 1 ^ 
1500 PRINT 
1600 LET TO ^P^t 
1700 LET Tl •72 
liOO NIET K 
1900 IMD 



This program was run several times each time with Tq = 2 and Tj = 3 . (See computer 
output on the following pages.). 

The first case (A = .5 and ~B = 1) shows an economy .which oscillates ahout 
2 and eventually -settles down to 2 . Do you think changing Tq and/or would 
effect the long riin behavior of th£s economy? 

The second case (A = .8 and B = ^2)' also oscillates (about' 5 not 2) 

"V 

but the oscillations become quite large. Indeed is negative!* From an economist's 

point of view the national econoiiy has collapsed at period 12 and the isolution 
ther€^2er is mieaningless. We return to this case in the next/ section. 

The thiird solution (A = .5 and 8 = «1) produces a national income which 
steadily decreases to the value 2 - Do you think a change in Tq and/or. would 
change this long run byehavior? Try values for Tg^ and. Ti where both are larger 
than 2 and where both are smaller than 2 . , 



TTPE mLOK FOR A 

7.5 ^ . ■ 

TYPE V^UE FOR B 

71 

TYPE MATIOlfAL XNCOHE IN ZEROTH PERIOD 
72 

TYPE NAT lOHAL INCOHE IN FIRST PERIOD 
73 

TYPE FINAL PERIOD TO BE PREDICTED 
740 

PERIOD NATIONAL INCOME 



2 


3 


3 


2.5 


4 . 


8 


■ 5 


1.75 


6 


^ 1.75 


7 


^ *^ 1.875 


8 


2 


9 


2.0625 


10 


'2*0625 


11 


2.03125 


12 


2 


13 


1.984375 


14 


1.984375 


15 


1.992168 


16 


2 


17 


2.003906 


18 


2«003906 


19 


2.001953 


oo 
ssu 




21 


1.999083 


22 


1.999023 


2Z 


1.999512 


24 




25 


\ 2.000244 


26 


/ 2^000244 


27 


2.000122 


28 


2 


29 


1.999939 


3a 


1 .999939 


31 


1.999969 


32 


2 


33 


2.000015 


34 


2.00001 5' 


35 


2.000008 


36 


• 2 


37 


1.999996 


38 


1.999996 


39 


I » 999998 


AO 


ft 
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T.S 

TYPE VIM.US FOR B 
T8 

TYFX MATIOIML INCOMX IN ZIBOTK PERIOO 

TYPE iMTXONAL XSCOME IH FIRST PIRIOO 
?3 

TYPE FIMAL PERIOD TO BE PREDICTED 
720 

PERIOD NATIOMAL INCOME 

a ' 5 

3 8.2 

4 12*6B 
9 18*318 

6 84.6608 

7 30.8867S 

8 35*67085 

9 37.19128 
to 33*18572 
II 21.13968 
18 ^ -1 •36198 

13 *36*0981 

14 -83.44197 

15 -141 •5134 ' 

16 . -805* 1849 

17 -864*8784 

18 -306*5084 

19 ^ -310*8146 
BO -•94*5416 



r 
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TYPE VAUSE FOR A 

TYPE VALUE FOR B 
7.1 J 

TYPE HATIOHAL INCOME IN ZEROTH PERIOD 

72 . .' V " .'^ • 

TYPE NATIONAL INCOME IN FIRST PERIOD 

73 

TYPE FINAL PERIOD TO BE PREDICTED 
780 

PERIOD NATIONAL INCOME 

• . - 8-55. 

8.8S85 
8.111375 
8*048631 
8.081178 
8.009817 
' 8.00401 

8.001745 . 
8.000759 
8.00033 
8.000144 • 
8.000063 
8.000087 
8.000018 
8^000005 • 
8.000008 
/ 8.000001 




147 



^•5 

TTFE VALUE FOR »f y ■ 

76 K ■ - 

Tm NATIONAL INCOME IN ZEROTH PERIOD 

TYPE NATIONAL INCOME IN FIRST PERIOD 

TYPE FINAL PERIOD TO BE PREDICTED . 

?20 

PERIOD NATIONAL; INCOME 



8 


5.5 


3 


• 11.85 , 


4 


83.875 


5 . • 


50.8185 


. -6 ^ 


107.8188 


7 


883 .'8881 


8 


'468.7488 


9 


949.1133 


to 


1934.67 


11 


3985.005 


18 . 


7934.507 


13 


15996*76 


14 . 


38166.14 


15 


64668.81 


16 


189760.3 


17 


860175.5 


18 


581334.8 


19 
~ SO 


1044i44« 

809«sea« 



V The final case' shown above (A" = ,5 and B = 6) produces a national 
income which grows without bound. Economists call this an e^cpanding 
ecOTOcy. Again try different initial conditions, and T^, to see 
if the behavior changes. 
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Self-Study; Problem #5>1 



The examples have eschibited the following behaviors: oscillating with 
decreasing' amplitude, oscillating with yicreasing amplitude exponential, decay and 
exponential growth. - For the following values of- A - and B determine the-be^avior / 



of the economy 






(a) 


A = 


.5 , B •= .5 , To = 2- , Ti = 3 


(b) 


' A = 


.5 , B. = 2 , To = 2 , Ti = 3 


(c) 


A = 


.5 , b' = 4 , To = 2 ,'.Ti;= 3 




A = 


0.75,. B = 6,To = 2 , Ti = 3 


(e) 


A = 


.5 , B = 4 , To =2 , Ti = 2 


- (f ) 


A = 


.5 , B = 6 , To = 2^ , Ti =2 


(8) 


A = 


.75, B = 6 , To = 4 , Ti = 4. 


(h) 


A = 


1 , B = .5 , To = 2 , Ti = 4 


\ •. (xj 


A = 


1 , B = .5 , Tq. = 2 , Ti = 5 



4 ■ 



- i 



o 
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- ■ 

Solution 


,.; ;-:...-,„.• •. ^ ' ■.- 

to Self-5tudy: Problem #5.1 










••s . - I'- 










- V 














Decaying oscillations T 


10 = 2.-00239i 








" : Cb; 


piscillations with 'nearly' constant amplitude 










Tg* = 0.594 ' - 


• 






• 


- 


T'li = 3.505 ^ ^ 


• 

• Ik 










'Ti5 = 0-.506 












T20 = 3.436 


S . - • 






■ . 




> T2i^ = 0.492 










> CcJ 


■xncPcuo oscxxxs-uxozis . 












Exponentiai growth 


Tio = 596,859 










Constant 


T, - 2 










Constant ■ 










~ (g) 


'J 

Constant 


- " - 








.(h) 


Linear growth 




- 






(i) 




Tl n = 23. 998 




* 


...^ 


4 




>- 








?^ 




/- 






















.- . ■ / 


















* 

- 














- 


























* 
















'15:3 . ■ \ 






; } . 






























1 - 







ERIC V, 



8-5.10 



5^3 Governme&t Pmap, Priming P 



■ ' ■ / 

In the second case of the previotis section (A * ,8 and B = 2) the national 
income became negative at period 12. Stxppose we decide to prevent a negative Income 

by increaalTig govemneht spending to avoid such a ^collapse- of the econonqr. Some 

* ■. ' ■ ' - ■ 

natural questions which arise are: Will such pump priming for a few periods put 

the economy back on schedule? . If not, does this policy lead to ever incre^ing 

government spending? 

lo answer these questions we modify the program as follows: 

' ' ■- - 4 
100 PRINT ••TTPE VALUE FOR A* ^ 
, COO INPUT A 
300 PRINT "TYPE VALUE FOR B* 
^O INPUT B 

500 PRINT "TYPE iMTIONAL INCOHE IN ZSROTH PERIOD" 
600 INPUT TO 

700 PRINT -TYPE NATIONAL INCOME IN FIRST PERIOD" 
800 INPUT Tl 

900 PRINT -TYPE FINAL PERIOD TO BE P&£A>XCTEi^ 
1000 INPUT II ^ 
1100 PRINT \ 
1200 PRINT -PERI01>"*^-T0TAL INCOHE-^'^QOVT SPENDINO" 
leSO LET 6 »'l 
1300 FOR K -« 8 TO M 

1400 LET T2 ■ A*Cl4>B)4tTl - A«B«TO ♦ 6 
1410 IF Te>»0 THEN 1500 
■ 1480 LET Q • i - T6 - 

1440 LET T8 • 0 
1500 PRINT ICrT2#G 
1550 LET G » 1 , 

1600 LET TO • Tl v 
1700 LET Tl - T2 ' . . !. 

i-loo Nsrr K . ' ' \ 



Tf' T^< 0 we increase grovenuneiit spending so that «"0 , i.e., 
^(5.7) ■ " A(l + B)T^ - ABT , 

To find Gy^'^^hen we compute the right >ide of (5.7). If this is less than 1 we • 

set 1\ 3nd compute from (5;.5)- If not, we let be the value defined 



by (5.7) and let = 0 . The program actually computes 



T = A(l + B)T , - ABT ^ + 1 
• n n-1 n--2 



If this is less than zero, then the program sets 



G' = 1 - T 
n n 



^^nd then sets 



T = 0 
n 



The numbfer of the period, the value of T^ and the valuer of are: printed. The 

results of running this, program are shown on the following , page. Notice that every 
14 periods, goye.mment spending must increase above 1 for two consecutive periods. 
Notice^so that this^pump priming does not increase with: time. A total additional 
government investment of 52.47875 is "required in each 3,4. ^ears (plus of course the 

' : " - - . ■ V- . . . ■ ' , - ' 

normal spending of 14).^ ; . , 

Interim Project #5.1 ' . ' 

See. £f you can reduce the total government expenditures by making government 
^ spending negative for several periods in between the periods wherfe government spending 
ivs abnormally high. 'Try^ different strategies tol see^ow well you can <Jo- 

******* *^ 
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TYPE VALUE FOR B 
78 

TYPE MATtOMML INCOME IN ZEROTH PERIOD 
?2 

TYPE NATIONAL INCOME IN FIRST PERIOD 

TYPE 'FINAI, PERI^ TO BE PREDICTED 
7A5 



PERIOD TOTAL INCOME GOVT SPENDING 



2 

3 

A 

S 
^6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30. 

31 ' 

32 

33 

34 

35 

36 . 

37 

38 

39 
• 40 

41 

42 

43 




12.68 

18*312 

24.6608 

f 0.88672 
5*67085 
37*19128 
33*18572 
21*13968. 
O 
0 
1 

3*4 
7 . 56 
13*704 
21*7936 
31*37824 
41*43802 
50*24605 
55*2897 
53*3016 
40*^6032 
12*6^221 

0 Y 

0 I 

1 ■ . \ 

3*4 .V \ 
^•56 

13*704 / 
21*7936 V 
31*37824 
41*43802 
50*24605 
55*2897 
53*3016 
40*46032 
12*82221 
0 
O 
- 1 
3*4 
7.54 
IS«T«4 



33*96322 
20* 51 553 



33*96322 
20*51553 



2*36192 
33*82349 
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5*4 Analytical Solutioa 



From Part II of the appendix on "IXif f erence Equations" we can find a solution 
of (5.6). As we have seen, we may have solutions which oscillate with increasing or 
decreasing amplitudes, and we may have solutions which decay or grow exponentially; 
Actually we may also obtain constant solutions or solutions which increase or decrease 
linearly. - - . < 

To determine the :nature of the solutions we examine the homogeneous equation 

> ■ 

'(5.8) V2 ■''^^ "'^^''trU '' '^''^ ^- " ' • 

Recall that in this equation A > 0 and ^ B > 0 . The characteristic equation of 
(5.8]Pis . ' 

(5.9) . x^ - A(l + B)x + AB = 0 

If the discriminant of this equation is negative >then the general solution oscillates 

and the particular .solution. will be a constant. For oscillation then 

■■ .... ■ ■ ■ ■ ' . ' ^ ' 

(5.10) a2 (1 + B)2 - 4AB < 0 

Suppose A is fixed- Then the discriminant is- a function of B , i.e. , 

(5.11) fCB) = b2 + 2ASA - 2) B + a2 

For B = 0 , f(B) = 0 . Similarly for B large, the term A^ B^ dominates 

in (5.11) so f(B) > 0 . Cbnsequently since B > 0 it must be that f(B) < 0 



only between the roots of f (B) . These roots are 



(5.2) ■ ; B- - , ■ 

If A > 1 then both of these roots are imaginary so the discriminant of the 
characteristic equation 'is never negative. If A = 1 then the two roots given In 

ERJC \ ' ■ ' 154 
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(5.12), are real and equal. Indeed In this case B 1 • Thus we arrive at one 
conclusion: 

If A >_1 . 'then the 'soZuticn of the difference equation (5.6) does not 
osdZl^ccbe* . 
The only possibility for oscillating solutions is: 

(5^i3) 0<A<1 

• . . • , ■ \ 

The solution oscillates if B is between the roots (5.12), i.e. , if B satisfies 
(5.14): , 2 - A - 2 2 - A-t- 2 

A ■ A. 

■ • ■ 

Notice that both boimds on B are positive. 

We now have a second conclusion: The soZuttan of (S.6J oscillates if and 
only if A and B satisfy both (5.13) and (5.14). 

The complete solution is , ^ • , 

T^ = Cir° cos(n 6 + C2) + 

«* * .' 

where 

r = . V , ■ - ■■ : ■ . . 



e = cos' 



-1 / --Ad B) \ 
\^ 2/AB j 



The amplitude of the oscillation is given by (y!AB)° . Now A 0 and B > 0 
hence AB > 0 . Thus we can conclude ^f- ^ 

(a) AB > i ,"^he amplitude o£ the oscillations increase as n increases. 

(b) AB'^ 'l , : the amplitude of the oscillations is constant. , 

(c) AB < 1 , the amplitude of the oscillations decreases, as' n increases. 
Of course if Tq ' and T^ are such that = 0 then* the solution is a constant. 
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EXAMPLES 

« Example. 1; Recall that for A'=* .5 and B = 1 the solution os^cillated with 
decreasing amplitude. Clearly (5.13) is satisfied.. The bounds on B are 

- 

.18 - S - 2 < B < 3 + 2 V^.- 5.82 

So B = 1 satisfies (5.14). " Thus the solution should oscillate. Since AB ^ 1/2 
the amplitude should decrease as n increases. 

Example 2: Recall that for A = .8 and B = 2 the solution oscillated with 

^ - . . . ^ - • . 

increasing amplitude. Again (5.13) is satisfied. The bounds (5."14) are 

.38 < B < 2,62 

Since B lies between these bounds, the solution oscillates. Then since AB = 1.6 > 
the ^amplitude of the oscillations should increase with increasing n eis it does. 
Notice that the long rxin behavior of the solution is independent of the initial 
values, Tq and T^ . 

Now A may satisfy (5.13) and the solution may not oscillate. If either « 

,^ . ^ 2 - A + 2 /I -A ^ > 

(5.15) B> — . 



or 

(5.16)' • . 2-A--2 ^ 



" then f(B) given in (5.11) is positive and the roots of the characteristic equation 

' - • • • ' ■ ' ■ 

" (5.9) are positive. The largest root of (5.9) is . 



A(l-+ B) + /Ai^d + B)^ - 4AB 



(5.17) > X = 2 



( 



ERIC 
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&-5.16 



■ ■ . ' ) 

-Suppose (5. '15) holds 'then 



2 - A + 2 /T^ ^ 2 - A 

^ =^ — —i. > —T- 



so 



Ad + B) 
2 



Thus 



A(l + B) + / A^ (1 + B)^ - 4AB ^ ^ 



CP 



Therefore* at least one root of (5,9) exceeds 1 asxA the solution grows exponentially, 

. -■ .^ . . ^ 

On the other hand, suppose (5.16) holds. , ^ 

Then . 



B < 2 - A- 2 A-A ^ 2^ 



so 



-(5.18) - 2 - A(l 4- B) > 0 

Now if (5.17) is, to be less than 1 then^ 



, <5-19) 2 - A(l + B) > / A? (1 + B)2 - 4AB 

Of course, (5.18) does not guarantee that (5* 19) is valid, but (5.18) is certainly 
necessary if (5.19) is to hold. The 'only other condition required to assure (5.19) is 

'/y {2 - A(l + B)}2'> a2(1 + B)2 - 4AB 

"» - 

. -which reduces to ^'■^ 

• ■ ■ ' . ' ' ■ 

A < 

ERIC . 
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Therefote^ both roots of (5.9) are less than 1 if (S.16) holds. In this case the 
solution decays exponentially to 1/(1 - A). 

We now have another conclusion: The solution of (5.6) decays exponentially to 
l/Cl"^ A} if A satisfies (5.12) and B satisfies (5.16). The solution of (5.6) 
grciDs exponentially if A satisfies (5.12) and B satisfies (5.^15). 

EXAMPLE 

For A = .5 and B = 6 the solution grows exponentially. A satisfies (5.13) 

and 

A 

J- - " » • 

so' B satisfies (5.15). Thus we should expect the solution to grow exponentially 

y as it 'does. 

Finally we look at 



<5.20) . B. -2 - A . 2 ^ 



and 

. « X 2 - A - 2 /I - A 

(5.21) B= — -j^ 

In either case the discriminant of (5.9) is zero, and there are two real, equal roots 

. ^ • ... ■ > 

both equal to 

' ' A(l + B) 

2 

The complete solution of (5.8) then is . 

(5.22) . = (Cl + C2 n) (^;^V^>)^^+ v ' 
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If C5 . 20) holds then 

■ B > ^ 



or 



2 

Therefore » the solutions given by (5.22) grows exponentially. On the other hand, 
hand, if (5.21) holds \ . . " 

^ "/ ■ " - < ^ ■ . 

and . . 

Thus the solution in ^5. 22) decays exponentially to 1/(1 - A). 

This leads to our final conclusion: The solution of (5,6) decays exponentialty 
to 1/(1 - A) -if A satisfies (5.13) and B satisfies (5.21). The solution gvoas 
exponentially if A satisfies (5. IS) and' B satisfies (5.20). 

An of these conclusions may be summarized as 'follows : 

If- .. . ' • ■ ' ■■ ' ' . ' ' ' 

0 < A < 1 

then if 



2-A-2 /1-A 

2^ —L 



The solution decays exponentially to 1/ (1 - A) . If however. 



2 - A - 2 -~< B <" 2 - A + 2 Vl - A 

A 



the solution oscillates* . If . 

AB < -l 

ERIC < i55 
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the anq>iitude of the oscillations decays; "if 

AB - 1 

the amplitude of the oscillations is constant; ±f.. 

AB > 1 ' 



the^amplitude of the oscillations increases, 



Finally if 



2-A+2/1-A 
^ ^ —A 



the solution grows exponentially without bound. 



Self -Study;. Problem #5.2 ^ ' 

■ - . ' . . . ' 

Show that if A > 1. then the solution of (5.6) increases -without bound. 



/ 
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Solution to Self-Study; Problem //5>2 : 

If A > 1 the 0 > 4(1 - A) adding ^A^(l + B)^ - 4AB to both sides 
of this Inequality , 

A^ (1 + B)^ - 4AB > [2 - A(l + B)]^ 

or . 

/A^Cl + B)2 - 4AB > 2 - A(l + B) 

or 

Ad + B) 4- Va^^(1 -h B)^ - 4Ab" - > , 
2^ ^ 

But the left-side of this inequality is a root of the characteristic equation 

(5.9). Hence the solution increases (or decreases without bound depending 
upon the sign of the coefjf icient .of this term. See also Case I in Section 
2.2 of the Appendix. 



/ 
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CHAPTER V 
AUTHORS^ EVAX-UATION ^ ~ 

(Please circle bne of the responses to each question) 



Did' you attend the short course in 1974-75? 
Is tLts chapter ■ ^ 

(a) Too short 

(b) Too long 

(c) About right 

If (a) 3, vhich topics should be expanded? - - 



Yes 



No 



can you suggest topics to be added? 



If (b), which topics should be' abbreviated? 



which topics should be eliminated? 



-Could you read and understand the compuier :?rograms? 



(a) always 
^ (b) sometimes 
Did the interim projects seem reasonable? 
Were the self -study problems 

(a) Too easy • 
Was the number of self-study problems 

(a) ' Too large 

(b) About right 

, (c) Too small ^^ ^^ 



(c) seldom 

(d) never 



Yes 



(b) Too difficult 



No 
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?• Did you attemtp any of the self-study problems? Yes No / 

Are the solutions to the self-study problems 

properly placed (on, overleaf from problem)? Yes No 

If no, where would you suggest the solutions be placed? 



9* For each topic, how solid an understanding do you think you have? 

Excellent Good * Fair Poor 

Components of Total Income ' 

Types of Economics^ e.g., expanding ^ 

» . » , ■ * 

Pump Priming ^ 

• ' " ' .'. 

Analysis of Second Order . . ■ . -. . - - ^ 

Difference Equations ' .- ■ ■ _ ■ '' • . 



Economic Hodels '±n General 



7 • - . - 
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CRAPTER VI 



MODELING IN PROBABILI^ , 



V 1. 



■'5 



In this chapter, our view point ' changfes somewhat since the models we treat here 
are also treated at ah elementary level in a number of finite mathematics texts - 
TSns we shall give only brief Mtroductions which afe. inten4ed to' bring the modeling 
aspects to the fore. 

Probability Models , • / . . ^ / 

Probabalistic models occur in many fields. In this section we shall not 
attempt to survey the applications of probability theory, but instead we shall try 
to explain the nature of a. prob^iiity Cor as it is sOTietlmes called a stochastic) 

model. - • " ' 

The* basic notion in probability theory- is that of a randan experiment-. A 
-random experiment . is one for which the experimental ou^Ecomes vary significantly (in 



the opinion of the modeler) from one time to another- It is custcmary to ass 
that the set; of all ppssi^l^ experimental outcomes (the so;??? Ze„ space) Is well defined 
- anc that the relative freqt^cy (probability) of each collection of outcomes (events) 
"is known.' For simplicity we shall assume in the general discussion that |:he experiment 

only a finite number of outcomes,' although we shall Idter present two models- • 
which involve infinitely many outcomes! . ' . 

■ The sample space and the probabilities associated with the experiment must be 
specified by the modeler - they are^n<9t supplied by probability theory ci^itself. Fox 
-example, in the experiment of flipping a coin, iost modelers would assume that the . 
sampl^ space consisted of the two outccmes, "head" and "tail". Even in this simple' 
situation other outcome^ are conceivable, for example, "coin lands tta edge" ,• "coin - 
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tplls "away -acui^gets .lOst^\. Most, modelers would decide/ that ^he. last^.,tWQ outGdmes 
.were so rare that they" should not be : consid&red; but in>N9ny case, an important facet 
of any ptobability. model is the careful specification of -the sample space. ^ ' * . . - 
The assignment of probabilities to the events is usually made in one -or a 
^ combination of the fallowing ways: " * ' 

; ■■ 1). • A priori method - For ex^nple, symmetry considerations or other 

*prior theoretical assumptions may lead to an assignment of probabilities to the event^i- .r^ 
In --oiling a die, the ^sumption of a ''lEair die" leads to/the assignment of probability 
1/6 to"^each of the six outcomes. In Chapter III certain theoretical assumptions led 
to the assignment of the .probability;, >,NAt + o (At) ' , of a birth in a population of* 
size N • - - 

2) . A posteriori method - We observe many repetitions, of th^ random 
experiment and nse these observations to estimate the probability of each outcome. 
For example, we could roll a die several thousand times; record ^the number of times 
each event^9ccurs ; divide this number by the total number of rolls;, and then use the 
last p^ult as an estimate of the probability of the event. 

3) . Subjective method - We judge or we call in an expert to judge the 
I^obabilities^ This is often the method employed in decision* theory problems. For 
encamp le, the sales manager of a large corpora^on may be called upon to -judge the ; 
relative probabilities of having sales of $100,000, $150,000 or^ $200,000 next year: " , 
for some product line. ^ 

Regardless of the way in which the -probabilities are assigned, the assignment : • 

must -satisfy the axioms^ of , probability theory which are: r:«^P^ 

• :>::^*" - ■' ' 




^ 'P[E] ^ P for every event E , ■ " ' V. 

(Ja.Vi • . 2) 'P(Sj = .for the, certain event S , ' ; 

.•• .. .3) PIE' F] - P[E]" + P[P} if Er\F = <fi*.* ' .. ' •, 



*'5"s ajciom must be strengthened if the sample space is not -finite, see e.g., Parzen, - V 



We can now makfe the tasic definition of this section. 'A probability model^ for 

< - " ■ ■• * * ' ' ■ ' ■ - ' ■•■ ' 

*a random experiment* is /a set of assuii5>tions which lead to (1) fa well defined sampli^ 

spac^ and (2*) ^ assigcunent o£ probabilities to the events of that sample space, • ^ 
Naturally a given probability model may apply to many different random esperfinents , ' 
and we shall now briefly discuss four commonly occuring models • and some applications 
of each. . ' , . 

1) Discrete Uniform Model 

This forbidding title is merely a fancy/way of refering to the "equally likely" . 
model with which even non-probabalists are familiar. 'Concrete examples 'aire ■ . ■ 

a) Coin flipping: Prhead] = 1/2 , P[tail] = 1/2 

b) Die tossing: P[one] = 1/6 Pitwo] = 1/6, ... P[sxx] = 1/6 . 

■■ ■ ' 

In general if ^ - _ . , 

Axiom 1: Sample, space has, N elements^ si, S2» •••'^n 

and . . * 

Ax±om 2: Pis.] =PlsJ for all i and j ^: 

are satisfied, then we speak of the "equally likely" or "discrete uniform" probability 
model. this model it is easy to prove the 

Theorem ;^ ' ' ' ^ 

C6.2) * . P[s;^] = 1/N for all i' . > 

Proof : . S *^ 

By axiom 1 of the ^lodel and probability axiom 2, we have 

■ - . r p[Si3 = 1 • ■ - ■ ' 

i=l . 

By axi-Mitllof themodelj N • Pis .] = 1 for any i , which leads to (6.2). -.This ; 
completes the proof. • " 



'*XhiS usage differs' slightly from that of sojne texts. See Adams, p. 118, for example. 



Jl 



• It is' now clear that the theorem and probability axiom 3 lead to, a unique 

, ^ . . ^ . ^ ' ^ . ' • ■ ■ ' • ' - •. • • • , • 

specification -^or the probability of any event in our sample space. Thus our two 

axioms do -provide a pr'obat)ility model. , v. 

2) >• Binomlar Model - . • , ' - ' " 

Axiopi 1. - The s^^^e space consists, of a sequence of . h, trials. 

Axic5m 2. Each trial h^ only 2 outcomes ^ denoted by s (success) and f (failure). 

Axiom 3,?- Pis] = p for eafeh trial, independently of all otber trials- 

: - . ' p ■ ■ ■ ■ ■ ••■ ■ ' , . .. ^ 

Examples :. - ■ . 

a) Repeated coin tosses with s being the event "head". 

bl Getting 3, 4^' 5, 6 "Ca "success") vs. getting 1 or 2 (a "failure") in 

^repeated tosses of a die. - , " 

. - <f . . . . . ' ' ' 

c) Getting a defect Csuccess?!) asrrwe .examine a random sample of size n 
^ ^ . ■• . 

'of one day'^ manufacturing output (sampling with replacement). 

Although it is not diffictilt to show that the above axioms do specify the 

probability of any event in the sample space' and hence are a probability model, we 

confine outselves to stating the most interesting result .of this model. ' Xet K * 

denote the number of^dccesses in n trial tijen we have the - 



Theorem : - - ; ■ ' * - . r ■■ ■ ;^ . 

(6.3) ^ . ^ ' -FIK -kV-:^^^^ k-.0, 1, n . 

. - - \ ' * ■ 

One. also can show tb^^^ the mean number of successes is y ^ - np and that the 

variance :is a- ^ = np CX - p) 
3) Poisson Model 

This' model concerns an experijnent in which certain types of events occur 
repeatedly. The outcomes of the experiment are taken to be the number of these 
events which occur in a fixed portion of time or space.' For definiteness, we shall 



16-7 



See I^zen, P. 5^ f f for proof. 
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assume that we are interested in the nxjmber "of events which, occur in the time interval 
[0, t]* The saii5>le points are the non-negative integers. The Pbiss^ model applies 
\ When there exists a positive constat X such thatr — ^ ^ ; * , . • 

1) P[ exactly one event will .OQcuif in At] = XAt + o (At) . ^ .At 0 . 
C6.4) 2) P[2 or more events occur in h% \ = o (At) as At 0 . 

- ^ 3) The number of events occuring^in non-overlapping sixb- intervals 

' . . \ . ' of time -are independent oF each other./ 

xNotice that the Poisson model is the one ^tised in Chapter S of the number of 
births {.arid death^) . In 'fact that model really was concerned with' th'e competition 

* .between these two Poisson processes. 

If we let K be the ntimber of events bcciiring in [P, t] , then wte can prove 

■ " ■ • ' ■ V ■ ■ ■■ - ' - ' ' ■ 

• the . ^ • . \ 

'. ■ \ ■ . . " : ' . " ' . ■ ■ \ . ' ' ■■ 

-Theorem: 



C6.5) . P[K- = 'k] = e ^ ^ ■; v = Xt , k = 0, 1, 2, 



- The probabilities expressed in t4ie ' eorem are known as the Poisson law of 

- - ■ ■ • ■' . ■ • " " ■ • ' 

probabilities with parameter P • In out model u * has the value Xt . 
^ *...'■' • ■ - - , 

To .establish the the qrem, we can proceed as in Chapter^. Let' t now vary 

continuously and let ^ KCt) =^ number- of events that have occurred by time ^ 

Pj^(t) = P[K(t) =-k] , > = 0, 1,^2, ... . 

*. ■ ■ ' . 

Hence, as in Chapter 3, for ■k>0 ■ 

■ '■ ' • ■ ■ - ■ ' 



*The expert will observe that assumption (3) has been employed. 
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That is, to within negligible error, we have k events at t + At . when either . 

there were* k - 1 at time t and one mornB occured during Ct , t +\At) or there 

were k at time t and none occur ed during Ct, t + At) • Dividing by .At" and 

:. .• •; . ••• .^-^ , • , • ■ - . ■ - • ■■ . • •, --v ■ 
letting . At 0. , we, then have ' 



Similarly, .for k =0 , we obtain 



Now 



C6-8) P^(0)' = .P[k events at t .= 0 ] = 



1 i£^ k^= 0 
0 if k >. 0 



With these initial, conditions we can' recufsivjely solve, for the' P^^'s. For 
example, for Pq from (6.7) \ * ' " . 

_ ■■ . •= -xPo , PoCO),= I .■ ^ . _ .• ' ' . 

and the solution is : " ' " 

-Xt ■. ' ' ' ■ ' 

Then for Pj • from (6.6) , - • ' , 



^ .= -XPi' + Xe , Pi(0) = 0 



so 

Hence an induction .argument will lead to the theorem. 
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Setf-Study Problem #6 1: - . ^ , - 

. Esliablish the -above theorem using ^the generating function approach described 

*■'■"•..•'„-',. ' * ' . , ■ ■. " 

±31 Chapter 3 • •/ " ' ; " ■:'=. ■■ "/■•■."■' \ 



' to 
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Solution to Self-Study Problem fi6.1 : 

- '■ ■ * . " • • * . . ■ 

■ ' * - • CO . * ' 

Let P(x, t) = 5[ P, (t) . Multiply (6.6) by X^' and stim over k : Then 
add ' C6. 7) to 61) tain ' 



00 



k=0' ;k=i " ^ k=o . ^ 



N : • ' ' 



- - 1^0 . . k=o ^ 



Hence . 

■ " ' 4 , - • ' ' ' ■ S-' 

. . -. . = X X P -- X P X(x - 1) P . 

at 

The initial condition for P is 



.00 

PCX, 0) = I P^CO) = 1 

k=0 



Thus 



so 



X(x-l)t -Xt Xtx -Xt V (Xt)^ 
P=e.^ ^ =e e.=.e 2. — w 

_ k=0 ^\ 



for any fixed t , as the theorem asserts. 
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. The Polsson model has found wide application, some of the more, well-known 
iples are: - - 

1) - Number of fatalities by horse-kick per aTiniim in the Prxissian Calvary, 

• • • • . . ' • ' • * : ■ / . , . ; . ■ 

2) Number of alpha particle emissions per minute from a radioactive 
^material, ^ 

' ' - 3) Number of certain blood, components, in a cc of blood plasma, 

4) Number of vacancies per year on- the Uh.S. Supreme, Court (X " .S). 



\ Parzen gives nany "tjj^ook** examples for instance "Suppose one is observing , 
the times at which automobiles arrive- at a toll booth. Suppose the mean rate \ 
of the arrival of automobiles is given by X — 1,5 autos/iainute. Find the 
probability thait k automobile arrive in a two minute period." 

Here the assxmiptions C6.4) :are at least plausible. Setting X = l.*5 t ="2 , 

we \f ind f rom C6.5) that ' - ' . ^ ' : 

t , " . "■ ' , " , '■ ■ . . 

\ ; ' 2 3^ 

} ff ^ ^P- — e - " m -m , k^O, 1,2, '••««- - 

.k ' : . , - * V 

• . " ' v • ' ' ■ ' ' ' ■ 

The binomi^rijji^aw and the -Poisson law have a similarity in that they can be 

interpreted, as ^i^ng the probability of k successes. The difference is that the 

binomial law. deals with the number^-of successes in a fixed number of trials ^ . 

-^ile the Poisson law involves the number of successes in a fixed time ot space 



4) Exponential Model 



CSC 



bur final model concerns an experiment in. which the outcome is a^ waiting time. 
Specifically, suppose we are observing a sequence of events o enuring in time in 



accordance with the Pol>sson, Model. The experiment consists of . mea^fring, the time 
that elapses^before the first event occurs. The outcome can be anyT-positivie time- t 
so: our sample space contains an uncountably infinite set of sample points- In such 
cases the probability of any one value occurring is zero (what intuitive prphability 
would you assign to waiting exactly 35. 2 seconds?) , but it is possible to assign 
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positive^ probabilities , to time intervals This we now do, using our. knowledge of the 
Poisson Model. Let , . ; ' - ^ - • . ' 

F(t) = P[tiine of first event is j< t] . - 

1 - F(t) = P[ time of first event- is tj ■ 

' . ' >^ , ■, 

~ = Prriinnber of events in (0, t) is 0] ' ' ; ' 

= Po(t) ■; ' ' ' ': ■ " - v '-■ -.- • 

-\t 



Then 




on law, PoCt) = e , hence 

Again pursuing the Parzen example: ^ 

"Find the probability that a toll collector at a toll booth at which cars 
arrive with, mean rate A = 1,5 auto/minute will have to wait 

a) less than three minutes, 

b) Between .3 and 10 minutes, , 
. "c) exactly 3 minutes, 

for the first arrival." The solution is immediate: ^ 

a) Pitime of first event is;<:3l - F(3) = 1 - e""* 5 = ^98889 

b) ^ PI3 :i t j< 10] = F(10) - FC3) = e"^ - e"^0 = .0497*4 : ; / 

c) P[t ^3L = lim P[3 £ t <; 3 + e] ^ , / ^ 

* . = lim .[F(3 + e) • F(3)] 

v. • . • = 0 ^ ' - . . , 

. In conclusion we point out that all of the. probability laws are models for 

' - . ' \ " : ^ ' 7 ■' ' ■ ' ' " ■ . 

various si tuaticins. The modellng'^Viewpoints towards a given probability law is to 

ask •. . ^ - . i73[ . : ^ ■ > • ■ • • 
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1) What are the underlying axioms for the law? 

2) What are soiae of the real, world situations in which these axioms 
are" Capproximately) satisfied? ^ 



Interterm Project ; : ' 

. Work out an alternate Monte Carlo simulation from that- presented in Chapter 3. 
This tioie/hase the simulation on drawing 7^ random numbers. * The first nxmiber will 
be used to derive the ^t£me when the next event occurs,, while the second random . - 
number will be used to decide whether that event is ,a birth or death*- To f in4 the " ■ 
time T of the next event, we use the exponential lawi.. 

where u are/ the mean, birth ^d death rates and 'Ri- is* a ralidpm. nimiber between *w 

0 and 1 • ^ V - ' 

Thus, the next event is assumed to occur after a lapse of time 

; log^ a ^ Ri) 

- • T = - ^ 

. A + p , * 

^ . ., ,^ ■ - , 

Given that an event occixrs, the probability that it is a birth is 



L =^ 



X + u 



draw a second , random number R2 from the unit interval and if R2 < L 
declare a birth and otherwise declare a death. 

^ By replacing X - and; /p-. by an-d* * , - Cn = size of population)- we can 

simulate! more general bi^ death processes- In parti cular^^ the ^alogue of 

tbk de.ferministic ' A - BN case is A = A_ = aij- bi n , u = u = a2 + n , - 

. . ^ ' ' . * ' n • n - ■ . ■ ■. • . ^ 

(see Pielou) . • . ■ ■ " . ' ' . ' ' 
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. ' 6#2 Condttlonal Probability and Bayes Theorem^ 

Suppose you are an .o±X prospector. You would like t^r^!n>i^a gusher, but will 
be content with -a inore modest oiT deposit. From past experience -you^know that in. 
this particular geographical area drilling wells at random will produce a gusher 
iO% of .the time and a moderate supply 20% of. the time. The. other 70% of the. borings 
are dry. The three events • 

^ Ai = {gusher or large oil supply} '., , • ^' 

. =- {inpderate oil supplyj ^ . '\ . - 

^ ■ ■ A3. =^ {rio .oilO: '" ' ■ ■ . 

■ ■ ■ - ' . . ■ " : - ' ■ ^ • ■ ■ .15. ' u ■ ■ ' 

are 'a complete, mutually exclusive s^t. ^ Moreover 

/ PCAi) =::0.1 ^PCA2) = Q.2 .PCA3)=;0.Z - V 

* . ' ■ - *: ' . . ^ " 

Now suppose that cost of dfildin§ welis- is. too hi^h to take the .risk when the 

■ ^ . ■ ^ • .V - ■ ' ' ■ ' ' --^ / • . ' ■ . 
chances of , finding' .oil are so slim as ~this^^"30 yo^r decide, to", conduct ^s^ismic tests ^ 

"to 'increase the chances of finding oil. To . determine .the" effectiveness- of these \ 

■ ' ' ■.'*".', - . ■ * ' 

tests, you conduct tests over existing wells and over some' dry borings. When 
"conducted where a gusher is^known. to be present, the' seismic "^test produces a 
■ positive result 80% of'' the time , i. e. ',. ' > . v , 

\ \ ' ■ " ■ V-PCx |'Ai> =-a.3 ^'..."'[l' .^^ ' 

where - X /is the event /'a positive seismit test result". Wher0 modest wells exist • ■ 
the test is positive 60% of the time, and over, dry borings it is positive ^30% of the 
•time . Thus _ ' ' ■ ' ^ • >■ , 

; ■ . . PCX I A2) =^0.6 * ' . • . . PXX" f A3:) = 0.3 ^ . _ 

But what we Want to know is: "If-a seismic test is pos.itive,^ is there pii* o 
Tg-esent? And how^^much? In "terms of the events ^desciribed above w;e would like to 
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calculate P(Ai j X) and P(A2 | X) . The" first is the probability of a gusher and 
the second is the probability of a moderate oil supply. 

To ccnipute tUese probabilities we turn to BayesV Theorem, We assume that the*' 
following are' true: ^ ^ ^ * 

1) A complete set of mutually exclusive altemativesr can be found for 
the experiment 9 i,e,, these are events Aj , A2, . , A-^ such thkt 

, , :■ . _ . • \ - "■■ 

. - • • I ■ P(A ).= 1. : • ' 

' ■ ■ '• - i=i ■ ■ ■. 

and -,T* ... 



. ^' P(A.riA.) = 0 ' i, j = 1, 2, m , ^ 

2) The probabilities of each event'^^ja !the complete set of mutually exclusive 
alternatives is known, i.e,. 



■ P(A^) i = 1, 2, ...,.m 

are given. - c 0 ^ ' ^ . , 

3) Tor a particular event X , the conditional probability for the .event 
given that any "one of thl& A. occur is^known, i.e.., 

■■■■ ..-^ \ .■ -. ... ■ ■ : -■ .. >■ 

are giyen.- ' ^ - 

. *. These tTiree assumptions, ar^e. satisfied in. the* oil drilling .^ample where, m = 3 . 
Notice- that 2m' probabilities^ must be given inx'general. . ' . - ' ^ ^ 

We.- use this -^formation to. invert the condltibnal probabilities and compute 
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JBiayes Theorem ; * - " - . 

(6.9) . .?CAi I X) =^ pa 1 A,)": PCA,) \ : . « .• - . ^ - . 

■ . I- PCX I a')- p(a.) 

■ 3-1 . ^ ^ -■ • 

The proof may be found in most finite mathematics texts. ^ 

We now use\his theorem to solve the oil drilling problem posed abov^. Since 
m =» 3 » C6»9) becolnes " ^ ' " 



PCAj I X) - ' PCX 1 Ai) • P(^) + PCX I A2) •• P(:A2) •+ P,(X I A3) • PCAs) 

For i — 1 (giasherj ' . 

- T>fA \ - 0-8 X 0.1 

i'i.Ai I a; - Q g ^ Q -j^ ^ 0.6 X 0.2 + 0.3 X 0.7 

= 0.195 . ■ 

similarly. . ' ■ = . ' " \ . ' . " 

PCA2 ^ X) = 0.293 ' 
; P(A3 . I X) = 0.512 - ' _ • 

Therefore the probability of finding oil - -gusher or moderate - is 0.488 . ' 
A BASIC program^ to evaluate (6,9) is: * . 
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LIST. ' . •■ • 

100 PRX'NT "Na., 0F W J TJ ALLY EXCLUSIVE EVENTS IS"* 

200- INPUT M . 

300 PrtlNT ' 

400 KEM - *^ DATA: PR3BABI LITIES*:' PCACJJ), aF SET 3F 

S00\ KEM MUTUALLY EXCLUSIVE EVENTS ** 

600 F08 J=r T3 M 

700 PRINT "PFcaBABI LI TY aF EVEiMT"J J^" IS"* 

300 INPUT AC J). , * 

900 NEXT *i . ' ^ 

lOOO P«INt ^ • 

' 1100 REM ** DATA: CaNOITI0NAL PR0BABILITIES»P<X GIVEN ACJ>) 

1200 F3R J=J T0 M 
'1300 PRINT "PH0BABILITY 3F EVENT X GIVEN THAT EVENT"; J J "0CCURS IS" J 
1400 INPUT PC J) 
1500 NEXT J 
1600 PRINT 

1700V REM ** CaMPUTE JDEN0MINAT'3R aF E^. C6.9:) 
4800 LET .0=0 * ^ 

1900 FaR J=l Ta M , V. ^ 

.'2000 LE.T D=D+PC J^*ACJ) " . 

2i0Q -NEXT-J. ? " ■ . ' J 

2200 REM ** DEN3M1MAT3R 3F Eut- CA.9) IS PCX) ^ 
230O " PRINT "PR3BABILITY THAT EVENT X 3CCUKS " IS" 5 D ... 
2400~r'RlNT * : . 

• 2500 REM ** " C3MPUTE BAYES PR0BABILITr F3R -AC^) FROM C6.9> 
2600 F3R J=l T3 M ' . 

2700' LET BC spC J^*AC J)/D. - 
^2800 PRINT "PH3BABILITY3F EVENT "JJ;" GIVEN X.1S."5BCJ)^ 
2900 NEXT J ' . , ' 

3000 END ^ , / ' . 

Kotlce that in this program ' : ;^ 

-# .• A(J) = P(A^) . \ • V 3 = 1, 2, ^.m 

■' ■ - . \ ' ■ 

= P(X I Aj>. 'r 3 = 1.-2, m 

' . ^' ■ ' ■ v' ^ ,' ■' ' .. 

both of these are input to tl^ program. ^ The output is 

. • . . B(J) = P(Aj I X) . ^ i =1. 2, in . 

^ ' •■■ . " • ■ ■ \- ■ . ' ■ ' ' 

In aeddf? ion the' program computes and prints t • - ■ ■ ' r . ■ 



m 



PCX) = PCX i A.-) * PCA.) ■ ' 
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which p.s no more than the denojalTiator of (^6.9). * 

If the program ±s run for the oil drilling example the results ai^e: 



N3*« 01=' MUTUALLY ,EXCLSs1VF. EVENTS IS / ?3 
Pr^gBABlLITY 3F EVENT 1 IS ?0.1 

PfObAblLlTY j3F EVENT 2 . IS ?p*2' , 

;p<kaBAdii-lTV ^E EVF^NT 3 IS 70.T 

PK3BAtJlLlTY 3F*-Ev€nT',X G^VE•N~r>^AT EVENT' A ^CCUKS. I S?0 - 8 
PK3bA8ILlTY 3F EVENT X GIVEM'THAT EVENT 2 3CCUKS iS?0.^=. 
ieK38ABlHTY 3F FUE^-^T X GiVEvi 1 rtAT EVjCNT S 3CCUkS IS70.3 

'pit^tiAoiLlTY THAT EVENT X OCCURS IS ^0- -4 1 . 

Pf<3WArilLITl' OF EV^.NT 1.. GIVEN X IS .r95r2195122 
-PKaBASILITY 3? LVENJ S GIVEN X IS .2926i5292ft83 . 
*. PK-JbABlLrrr 3F event," 3* GIVEN. X 1 S. . 5 1 2 1 95 1 2 1 95 



Self-Study Problem # 612 ; . (Kemeny , Snell an<i Thonqjson) . ■ 

^ ^ . If a person has tube'rculosis its early detection is important "in order - to save 

' th| .patient's life* Chest x-rays afe one method of detecting tuberculosis when it 

„^ is present. . If a patient is healthy, the x-ray will indicate tuberculosis^^<present 
^ 1% of the' time,/ On the other hand, if a patient does, have tuhBT^i^:0'S^^^^^'T3:y^^ 
will fail to detect^ that fact 10% of the time. *If tuberculosis is pres4nc|^' .5: 'out 
of. every 10,000 persons, what i€* the probability that; an x-ray indicates MaoN^ 
tuberculosis when in fact the patient does have the desease? v - >4 . ^ 
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Solution -to Self-Study ^Problem 2: \ 

The mutually exclusive events are "tuberculosis" and "dTo tuberculosis". 
Since we wapt to compute ^ • * - * , * 

'p("tubel:culosis"^ | '^healthy x-ray").' 



we heed to know 



K"healthy x-ray" | "tuberculosis") 



and 



• P ("healthy x-ray" | "no' tuberculosis") 



Thje computer output is 



N3.'3F JlUTiJALLy EXCLUSIVE EVENTS IS 
2 



PKaBAHlLITY EVEi^JT 1. , IS . 

Pi<0ti ABILITY 3^' EVFNT.- 2 'fS 



?>.00O5 
'? .9995 



r'}<08A8ILITy 3F EvENT X .GIVEN TflAT EVENT 1 3GCUrS I^SPO . 1 
HK3HABI^ITy-'9F EVpNT X GIVEN THAT ^iVENT 2 |CCURS 1S70.99 



PR3BAB1LITY THAT E 



VE,^\ X, aCcaKS is 0.939555 n 



PKaB.ABILlTY <3F EVENT 1 GIVEN X IS 5.05277625-5 
-PK^bABrUTY ^F-^EVENT 2 GIVEN. IS' .99994947224 



"J -. 



■ ■\. ■■■ - • - ■ '■ ■ ■• ■ . 

Since event 1 is "tuberculosis", * ■ 

\^ ' . P( "tuberculosis" | '^healthy x-ray^') =^ 0.0000505 

' ■ • "^"^ . . *" . ■* " • ^ 

Notice that tuberculosis' is a rare disease ,. and^ the failure to detect it'^arries 
a stiff penalty* — .TherefcrefT^ if we are to err it should b^ on ^tte^s^ide of a-^ . 



« ileal thj, patient with a^ unjie^^lthy x-ray • 




ISC 



4 
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Self -Study Problem jg6.3 - . ^ . ^ . 

It is essential that flaws -in the equipment of a spacecraft be detected, if the-^ 
craift and its occupants are to survive an. orbiting mission. Elaborate electronic 
sensing equipment *is installed to detect such flaws even though _ they, rarely occur. 
Suppose the failure- rate of a critical part in a missile is . 1/10. of 1%^ . Suppose 
also that if the. part fails that 2% \ of the time the electronic sensing equipment 
does not detect . this fact. Finally suppose that if the part is functioning • ^ / 

Acorrectjy (not failing) 'the sensing equipment .will say that it does fail ' 5%- of- 

the- time. If the s^sing. equipment does not detect a failure, what is the 
- probability that nonetheless a .^failure exists? 



The mutually exclusive events are 

Ai « {part fails} 
• A2 '{part does not* fail} 



-and ^ 



P(Ai) = .001 P(A2) = .999, ^ 



The event ■ X is "no failure detected" ^ and we wish to compute P(Ai | X)* 
Therefore we need to know 



P(X I i^i) = P("nO ' failure detected" | "part failsV) =0.02 

^ PCX I -A2) - PC"no failure detected" | "part does not fail") = 0.95 

\ 

The computer output is ^"^^ 

N3. gr MUTUALLY EXCLUSIVE EVENTS' IS ' 12. _ 

Pi<3aA3ILITY 3F EVENT 1 IS ?0.001 . 

t^K'^bAblLITY 3F EVEiNJT 2 IS ?-0V999 . , . 

P.^^BAblLI TY V. vENJT X Gl VE:V.THAT EV.E^T 1 :3CCUKS iS?0.0^ 
PRObABILlTY OF EVENX X CU VEN TH AT E VF.,VT 2 .^CCU-'^S IS70.95 

p:^.3bAh5lLiTY THAI EVENT A, .3^CUK£ 13 0-94907 . 

• PrOBA-.fLITY .^F EVE-^T I GIVEM X ' I S 2 . 1 0 732(?. 1 2 
pK3oAt3ILITY ,3F EVENT 2 GIVEN X IS . 9999 7t59 26 73 A 

H^l I = PC'part fails" | ".no failure detected"y = 0.000021 . 
Notice that no failure is detected (event_ X) about 95% of the time. 
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6>3 ^Decision Theory^odels 



The theory of making decisireasr draws upon many fields including ethicaJL theory. 



■ the theory of utility, game theory, probability, and classical and Bayesian >^tatistics. 

■ • ' • ■ ^ • . ' - V - " ■ 

/ Certain brandies of decision theory' have become cr5mm6nly used .in the behaviotal and 

manageinent: -sciences im recent years, part icularj^y, in the growing field known as 

operations ^research. « ■ . ^ » - 

In genera!t'":we have imperfeqt knowledge of the factors from the outside world.: ' 
Neyertheless', we wish to make th^ ^best' decision^ven in the face of these knowledge 
gaps- In this^ section then we will develop several decision theory models each one 
taking into account and using as much knowledge of the world as there is available 
to us. As a pedagogical devicer, we shall develop a flow chart for decision making 
-as we discuss the various decision theory models.^ The flow chart will be developed 
piecemeal with each^piece' being appropriate to some state of our knowledge. At the 
close of the section you will be asked to integrate the pieces into a coherent whole. 

As in the earlier sections, we shall 'discuss finite sets in the general 
discussion, although some of our examples wil%l- involve infinite sets. 

\ ■ ■ 



^"^T ART) 



I LIST DECISIONS di, d2. 



Tigure 



6V 



As indicated j.n figure 6.1, the first /step in a decision theory problem is to 
define the set D = {di , . . . ,^ d^} of possible decisions. In some ^^s, each decision 
•leads to a'uniquely determined -outcome. . In this, situation, we need "only'' decide . 
which outcome we prefer- and make the appropriate decision. Of course, deciding which 
outcome we prefer may be either trivial or close' to impossible. ... 

ERJC ■ ■ . . ^ . . : X 
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. Fyampie 1 ; (Felbes) ^> • ^ 

"You may invest in one ,of A^^B, C. - Each^nvcstment costs §500.' The yearly . 
returns on A^.B, q are 3%, 5% and B% - respectively. ^ VThich investment will you\ choose?. 
. Analysis : The possible -decisions are <I]f>- invest in A , ^i invest in B , and 
da = invest . in C The pctc^me of di is a profit of (.03) ($500) = $15 and 
similarly the outcomes of dg and d3 are profits of $25 ' and $30 'respectively.^ !■ ' 
Here the decision is- presumably trivial. Choose C . . 

Rir ample 2 ; . J ' 

Your "father is 75 years, old and needs an opera^slpn. Without the operation, he 
Tij'ill die within 6 months. If T^e survives the operation (50% chance), he will 

^ probably live for at least 2 years, but will be an invalid. Do you recommend the 

operation to him? " — ^ ^ 

Analysis: The possible decisions are di = recommend the operation, ' d2 = advise 
against the operation. The outcomes' are as gi-^^in t^e example. Here the decision 
is far from trivial as it involves one's personal ethics and emotions. 

' The rating of outcomes 'is one of fimdamental problems^of ethical theory. .There 

is a relat;^ed mathematical theory known as utility theory (see Chapter II of Luce & 
: ■ - ^ 

- Raiffa for -an introduction $o utility theory). In any case, as we shall' see below, 

many decision theory models require that 'one assign a utility (equivalently a 

"payoff" ox a "loss") to various outcomes. Although we shall not emphasize t1iis> 

point 'below^ the possible difficulty in assigning such payoffs should be kept in mind 

whenever utilities are required (see e.g., example 2. above). 

-■\ Formally we have "the following axioms: • . 

. \ , ^ " 

1"). A set D = {,di, d^} of decisions is specified. 

2) A set D= {Oi, 02,-..., Op} p^n , of. outcomes are specified. 
j ^ ,3) For any ^iven decision, dj^ ,^ there is a unique outcome, . Oj . " - 

The mechanism, for 'making the decision is to rate the outcomes, using ethical- 
theory, utility theory or the liTte, and to select the decision which gives the most ,,. 
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■ favorable outcome. This branch of decision theory is known as "decision under., 
certainty". , We may -now further "deyjelop our flowchart. shown in Figyj^ "6.2. 



(STAKT) . 







LIST DECISIONS d] , d2, '•''■ ■^n 


8 


■ 1 A ' . • - 




YES 



LIST , OUTCOMES Oi , "Oa , • r 0 



Pi 



-USE UTILITY THEORY TO RATE 
■ THE OUTCOMES 



"pick the* -d- WHICH GIVES THE 
, BEST QUTfX)ME 0^ 



C STOP ) 



Figure 6.2 



In our next decision model, we assume that the outcome of a decision is 
influenced by a rational opponent who has a set S^ = *{si, s^} of decisions ,qt 

strategics available to him. We assume that to each decision d^ and opponent 
strategy s-' there is a definite fttcome 0^ _ . This situation and it generalization, 
' to more" than two rational -agents is the sub;ject' of game theory. The classic 
expository text on game theory, is that -of Luce & Raiffa, but Elementary treatments may 
Be fbimd in mosf.-texts on finite mathematics. \ • 

• We will assume".that numerical utilities for -each opponent are known for each;^ 

' '■ > : . ' . ■■• ■ ' ■ ■ , * 

of the' outcomes 0. . . The "gamer" is usually. di-splaye;i by means of a payoff (utility) 



ij 



matTT^.. whose entries are ordered pairs representing the utilities to ea^ plajyer. 
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Fo 




decisions 



d2 



opponent 
strategies 

. SI ■, 



C3, ^2) 



CIO, 



3 > 



S2 



CO, 10) 



C4. 4) 



. Here the pair (0, 10) means 'that if we make decision, 1 and our-^^ opponent employs 
^. strategy 2 then our payoff is , 0 . and our oppcpient's payoff is 10 . Similarly 
• for the other entries in the. matrix. 

Example 3 ; (Adams) • • . ^ ^ ' ' 

'\ • "Two duopblists, the ''K6w^ and Column Corporations,- are competing for shares of .' 
a million dollar market. The following payoff matrix describes the profit Cin 
hundred-thousand dollars) of the Row Corporation for variotos choices of strategy 
of the two corporations. The Colixmn Corporation's profit for the given choices of 
strategy is the difference bjatween one million dollars an^J the Row Corporation's 



profit . 



vs. 



Column Corporation 



Cl 



C2 



C3 



Row Corp orat ion 



R2 
R3 




5 
3 
6 



4 
3 
4 



4 
5 
3 



Rows Ri, R2, R3, correspond to tlie Res? Corporation selling 10,000 uni^ts, 12,000 
units and -14^000 vmits, respectively of its product. Columns Ci , C2 » and C3 

correspond' to the Column Corporation selling 1&,000 , 12,000.,' and 14, 00b<^ units 
respe ct ively . 
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uArtalysis ; ■ The full utility matrix / - 



\'' Cr. * :'; C2 ■ ■ . Cs- - 



R3 



(5, 5) • • C4, 6) . (4, 6) 
(3,. 7) O^lV C5,-5) 

(6, 4) (4, '6) (3. 7) 



The Row Corporation reasons fes follows. . If we decide Ri , then no- matter what 



. th(^:Sdl}^^C^ is at worst 4 • Similarly the worst we 

*- ■ • ' ' ■ - ■ r . ^ \ "\ ' . . • ■ 

- can . do with R2 is 3 and with R3 is 3 . Since the/Column Corporation wishes 

to maximize its profit"*, we dare not decide R^ if ^fte Column Corporation is likely 

to decide Ci or C2 , and we dare not decide R3 if thfe Colximn Corporation is 

• tf . . , . ■ " 

likely to decide C3. . 

To decide whatL the Column Corporation is "likely to do" we need only reason 



latLlihe Co] 
of v^w. 



from their point of v^w. ' If they decide Ci the worst they "can do is 4 , 
similarly the worst outcome -for C2 is 6 and the worst outcome for C3 is 5 . 
A conservative -strffBi^y for the Colimn Corporation then is C2 since no matter 
what the Row Corporation does, the Column Corporation will realize $600,000 . 

Thus the Row Corporation's conservative strategy is Ri , and^fhe Coltmin 
Corporation's conservative is C2 which leads to the utilities (4, 6)^. Now 
suppose. the Row Corporation does not play' 'Ri Then if the Column Corporation 
contrlnues its conservative strategy C2v,. the payoffs wiH be either 3 or • ' 
But with Ri the Row Corporation has a payoff of 4 already. Thus the Row 
. Corporation has no incentive -to alter^ its strategy from the conservative Ri . 
Similarly the Xlolumn Corporation has no incentive to .alter - its strategy from the^ 
conservative C2. , since if the Row Corporation continues Ri the payoffs are 5 
' or 6 as opposed to 6 ■ ^ - 
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.,, .. The "rational behavior" for theN^ow Corporation ' is fco decide Ri , i.e., sell 
10,000 units' and for the Co 3,uinn Corporation it is tb^decide C2 9 i^e., sell - 
12,000 TJHitS. ' " ^ " ' . 

In general, the conservative strategy for the "row player" is to compute his 
ijtinimumj-payoffr f or each row and choose, the row with the largest miniiiiuin payoff ^ (the 
•Wxinitm'V strategy:) Similarly the conservative strategy for the' "ccfc^^umn player' 
is to make a similar computation for the columns. If theae considerations lead to 

'a payoff for ttie "row player" which cannot be improved ^ven if he knows 'that the 
^'column player" will-be conservative and to a payoff for the column player which 

.cannot be improveci everi if heJcnqtJS that 'the row player, will be conservative, then 
the "maximum" strategy is taken to be :optimali ; ' . . 

Example 4 * . (Adsms^) . : . • ' : • . ; \ ' - ^ V 

t ■ ' " / • ■ • ■ ■ ^- ■ ' 

"Determine optimal strategies for the row and column players for the game . 

defined by the payoff matrix" ^ * 



> 


*(5, 


-5) 


(1, 


-1) 




<2, 


-2) . 


' (3, 


-3) 



Analysis ; Here if the row player chooses Ri. his worst outcome is 1 and if he 
cItooses-'R2 , iiis worst outtome is\ 2 . Thus his maximum choice is R2 . Similarly,' 
the maximum choice 'for the column player^ is C2 .' However/ if the c6lumn player 
kneu) that the row player would choose R2 he could do better by 'changing his 
choice to Ci . ' " . * . 

Continuing the analysis in this way, we soon conclude that there; is no rational 
choice between Ri and R2 • The «^ay out of this dilemma is to adopt a "mixed 
strategy". That is, choose Ri " with a probability p and R2 . with a probability 
1 - T>'-.^ It -is o^lvxin decisions against a rational opponent that one would' employ: 

• t"" ■ # " . ^ ' ' ' ■ • ■ ' ' • ■ ' ' ' ' ' ■ 

mixed strategies, §ince only in this case is one con ce.mied with .dl^e^ s decision bei-ng 
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discovered and exploited, >It is a classic result* of game theory, that in "zero-sW* 
games (such, as that in the last table above), an optimal' mixed strategy can be. ' 
f,oundJ'. We refer the reader to. the sources mentioned ^ above for the theoty of mixed . 
stxategy as well as for the the theory- of competitionfj^and cooperation among two . pr 
more rational agencies. The axioms for the game theory model of decision making 



are . 



1) -^-A set , D = .{di, d2, d^} *ofr decisions is' specif ied. 

2) A.^et S ='{si, S2> • • ? s^*} " of opponent strategies are specified,. 

3) The outcomes are detexmined by the pair" (d., s,)» ^ 



J 



4) For each outcome (d., s.) each player has; a specified utility 

' ' ■ • ' ' ^ ' . ■ . ' \ ' • V-v ^' ' ^ 

and all of these utilities are knowS; -to each player.- 

Once again we remind the reader that the various , sets above need not be finite 
^ee Maki-Thompson, P. 60 ff , for an exampile)'. • We can now extend our flow^ chart as 
shown in T*igure 6.3. " ' J ' . - ' ' ^ . 



4: 
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YES 



I. 



LIST OPPONENT STRATEGIES 
, . S2 > - ■• • • i Sjj^ 



GIVE OUR UTILITIES FOR THE 
PAIRS (di,-s.p'^ 



GIVE OPPONENT *S UTILITIES 
FOR THE ''pairs . (d^, Sj) ' 



PLY GAME THEORETICAL METHODS 



CSTOP ) 



Figure 6.3 ^ 
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In our "final group :'of decision models,, we* assume that the outcome of a 
deci^on .is influenced by. a "state of nature". By this we mean any non-rational - 
^ age^cyl For' example^ we might be^trying to decide whether or not, to carry an umbrella.. 
The decisions are di = carry ^umbrella, d2 = leave umbrella home. The states of • 

• nature might si = will rain today, s"2 - won't fain today. In any case the 
possible states of nature S = {si, S2, s'-^l are assumed to be specified. 

' There' are three types of knowledge that jiiig]it help uis make, a decision against nature:. 

• * 1)' The utilities U^, for the outcome 0^^ , ''specified by a deciision d^ and 
a state of nature s. may be spregifled. . . 

Z), The probability p^ that a given state o£ nature wil^ occur may be f\ 
■ ; given/ / ' ; ' "\ 

' 3) We may be^ able to carry out some experiment whose outcome is inf lue^xited^^-^^^^^ 
(depends upon) the state of nature in effect at the time the experiment. 
- was conducted. ' 

In a given case we mi^ht .ha^^ any or all of these types ofi knowledge. Hence" there 
are - 2^'= 8 alternatives possible for decision theory wl^^ Xhe decisions are against: 
nature. The eight alternatives arer ^ ^ ' * . ' 

^ A) Utilities are Known,. No Probabilities Known, No Experiment \Availafale. 

B) ^Utilities and Probabilities are Known, No Experiment Available, 

C) Utilities and' Probabilities are Known, Experiment is Available. .\ . 

D) Utilities, are Known, No Probabilities Known," but an' Experiment i& •/ 
Available. ^1 ' ' , ^ " - ' . 

. E) • ISo" Utilities or Probabilities' Known, but- an Experimefit is Available. ^ 

F) No Utilities Known but Probabi^ties are Known and an Experiment is ' ' 

- Av&ilable. * ' . ^ - 

.. , ■ * < . . - • ^ ... 

G) ' No Utilities Known and No 'Experiment is Ayaiiable, 'by.t Probabilities . 
are Known.' ' - ^ . ^ ^ 

-H) Nothing is Known. 



-.W* consider each of 'the^e in turn in the ordfer shown above . 

Am -Utilities are Known » No Probability Knovm, No Experiments Available » 
■■ ■ ' ' . ' * 'J 

In decisions against nature ^the case when only utilities are known is called 

'Mecision under uncertainty". There appears to be no univex:sally acceptable "solution 

to this problem, and a rather thorough survey is given in, Luce-Raif fa. Chapter 13. 

We shall confine ourselves here to a brief ^presentation of some' of^tiKeymore common 

7 . ■ - 

methods of treating decisions under uncertainty- 



Example 5. (Luce-Raif f a^ ' Consider the' utility matrix. 





SI 


^2 










d-l 


0 


100 


f 








d2 


1 . 


1 




^ 1 







Which decision should we make? - ^ , - . ' .. • , ^ * 

> ^:^ 

. - \'t " ■ 

The conservative approach' is- to retain the game vtlieory criteri'on of Maxi - min 

Utility- Sirice the first" row ^has minimum 0 and tSe second row has minimum^ , the 
^tnaxi ^^;^min choice is the second row, i»e., decision ^2 * . - 

* - ^i&ince' we are not competing with a rational opponent, the maxi - min criterion 
?|aaj^' be .linduly pessimistic. Thife is especially £rue in a case;^such as that shown 'in 
the above table where we pass up all chance of a gain of .100 to assure a gain of 
only ' i \-\ An alternative, decision' criterion is "^ihi- Max. Regret" Again referring 
to the above example, if we make decision d^ and si is the true -state of- nature, 
we have a "regret" of 1 , since we could have received^a payoff of 1 greater by- 
deciding d2 . Similarly " if we decide d2 and si is the'-state", we havis no "regret-s' 
but if: S2.. turns out to be the true state our regret is 99 . Thas. we " can replace - 
the utility matrix of^^p^ample 5 i>y the regret '^rnatrix • . . ^ ' ^ * 



000505 



to detect' it 






■ ■ ■ ^ 










1 








0 . 


99 




t * 

. • V . _ 






• 

Now if we 


decide dj our maytTrmm regret 


is 1 and if we decide d2 our maximum 


r6gret is 


99 . Therefore, we 'Choose 'the smaller 


of these mascimum regrets ' (1) 
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A 



and make decision dx « 

In general the regret r^^ corresponding to the utility u^^ is given by 



r, . = rnaxCU. .) - U. . 

'j • 



Although HThe mini - max regret . criterion appears atitractive in this example, 
it is no pona'cea as the following example shows- , ' ' ^ 

Example 6 > 



CLuce-Raiff a> Consider the utility matrices 





SI 


S2 


S3 




0 


10 


'4 


■d2 . 


5 


'2 


10 


/ 


* SI 




S3 


di ■ 


0 


10 


4 ' 


d2 


5 - 

*» 

v 


2-' 


.10 


d3 


10 


5 - 


1 



n 



Note that the matrices hav§ the same first two rows - i»e*, decisions ' di and d2 
have the same utilities in each matrix- 

Analysis : For the first utility matrix, we have the^ f ollcwing regret matrix 
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■ A 




4 




— 0 








1 




^1 


















5 • 


0 


6 






I, 


• 






U 


Q 
O 





























Hence di -Jjjas Tfiaximum regret 6 and d2 has maximum regret S . Thus the mi^;^ 
'^'-sa^ regret criteria s.elects di as optim^ and 6,2 is non-optimal. 

-TIow^ consider the second utility matrix which in effect merely adds a new^ 



decision . The cori^spondiftg regret matrix is 



/ 



\ 





Si 


- S2 


S3 


di 




6 


% 


. d2 




8 , 


r 0 


d3 ^ 


,0. 


5 


9 



r 



•y 



V 



Hence dj has maxixnum regret . 10 , d2 has maximum regret 8 and -d3 has 
" maximum regret 9 . Thus the mini - max regret criterion^ now selects d2 ias 
optimal! That ts adding an "irrelevent alterative" has changed d2\ froiu 

non-optimal to optixflal. . ^ * ; ' ^ 

Luce-Raiffa (p. 288) give the' following humorous illustration of this type ^'^ 
incongruous result: ^ 
^ DOCTOR: Well, Nurse, That's the evidence. Since 1 ipust decide whether or not 
is tuberciilar, 1*11 diagnose tubercular. ' 



NURSE : 

DOCTOR: 
NURSE : 



But,' Doctor, you do not have to decide ope "way or the other, you' can 

^ 

you are undecided:. - - , ■ ' 

...... " ' ■ ' ' 

-That's true, isn't it? In that case, miark him not tubercular. , 



Please repeat that ! 



The" final criterion we shall consider for making decisions under uncertainty 



the "principle of insufficient reason". "Hire one asse;rts that if "one is "comply 
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Ignorant" as to' which state sx> Sm obtains, then one should behave as if all 

states are equalji likely- This means that we assign probability ..l/m to ftach stat* 
of nature. • Since decisions vhen both utilities probabilities of the states of ' 
nature are given is considered in the next section,- we do not pursue this criterion 



here. 



To repeat the axioms for ^e model of this se'ction are: 

1) A set D = {di, d2, °^ decisions is specified. 



2) A set S = {sj. 



S2, 



fn 



} of states of nature is specified. 



3) • The outcomes are determined solely by the pair (d^,.^s_.)- 
-4) For each outcome a utility ' j ' is specified. 

The procedure is to select and use a "decision under uncertainty" crxteria 
such as. those discussed^in - this saction. 

Our flow chart can be cocitinued^i^as shown in Figure 6.4 ^ . 





FIGURE 6,4 
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0 



NO- 



DECISION IS UNDER 
UNCEKTAINTY USE 
CRITERION SUCH AS 
MAXI-MIN UTILITY , 
MINI-MAX REGRET, 
.PRINCIPLE 
INSUFEICIENT 
REASON • 



(stop) 
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itles and .Prob abilities are Known, No fixperlmeht Available ^ y ' • ' . , 

this case (knovm as "dedisions under, risk") we can Compute the expected 
of each decision d^ : ■ * "T^ \ 



/ 9- 



r 

A 




- P. - probability -that state of naturci^ s* c^c curs, and U.. is the utility 

for \ ''i ' ' ' J . 

outcome corresponding to the decision d. and state s. • A straights forward 

■ ^ * * 1- r 

and • - ' . 

. . ^lisible procedure is to then choose "the decision , d, which has the grei 

* , . i ' * . 

^^^^^^.tion. The axioms for this model are ^* ' ^' 

1) 'A set D = {dxj.. • • • / of decisions is -s^cified, 
y . 2) A $et S '= fsi, S2, s^} of states of nature is specified, . 

3) The outcomes are^d^jt ermine d solely by the pair (d^, Sj) , 

4) ifor each outcome a utility U,. is specified, 

5) 'For each state of nature a probability P. of it pccurring is 

fcnown. ' / . . U . , 

. ^ ■ : / - ' 

Vrocedur3 is th§*i'to choose the. decision ^'with maximum^ expected utility, 
practice the probability/ P,' mi-ght involve subjective judgments or might 
^ approxmately- known. Nevertheless in order to use this mode'l, we -must accept 
^^^^^ .probabilities -as final.v/ . ■ , ^ 

^^"^ Bj^g^, (Feibes) We return to our thfee investments ' A, B, C of Example 1 . 
^^^^ il^estment costs $500, and they have respective returns of 3%,. 5% and.. 6% • 

• .^Ovever, we assume that the returns are ^not^ certain. It is possible for each y 
-^^^^^t^tient to result in either the given percentage return or a loss of $5 • 

Specif j^^^^-^ the probabilities^ of ^a positive return for A, B, C are .9 , ,5,^ 

^ > V ■ . * . . \ 

and ■ " 

*2 respectively. Which investment should we make? 
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A 

Soxind(.9) 



Unsound (•!) 



B ' B 
Sound (. 5) Unsound (• 5) 



S oundX • 2 ) Un s bund ( . 8) 





$15 


; -$15 


$ 0 

r 


$ 0 . 


$ 0 


'$ 0 


B 


$ 0 


" .$ o" 


$25 


' -$ 5 


$ 0 


$ 0 . 


C 


$ 0 


$ 0 . - 


$ 0 


$ 0 •* 


$30 


.-$ 5 



Expected value for A = (ll)(.9) + (-5)(.13 = $13". 00 
Expedited value for B = (25) (.5) + (-5) (.5) = $10.00 
* Expelte^/ value' for C = (30)C.2) + C--5)C.8) = $ 7.00 



1 



Using expected value as a decision criterion, we choose investment A 
Our flow cliart is extended as shown in Figure 6.5.'' 



'V 



GIVE PROBABILITIES P. 
OF THE STATES OF ^ 
NATUKE ■ Sj 




-NO- 



-7- 



COMPUTE 
EXPECTED UTIf.1^- 
FOR EACH DECISION 
d. 



PICK THE DECISION 
WITH MAXIMDM - 
EXPECTED UTILITY 



( STOP 



Figure 6*5 
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C. Utility and Probabilities are Known, ExpfeKiment .is Available . 



In this case the experiment is- used to revise the giveu probabilities of the 
states of nature. J^e may wonder why we should bother with the experiment if the . 
probabilities are "given". There are ^two reasons, first of all ,a^ mentioned above, 
the given probabilities may only have been obtained through subjective judgments 
or approximations* Secondly, we may have the probabilities for a T?opulation as a 
whole, while we ar^ fac^d with. making a decision involvifi^ a particular sample from 
this population. ' * 

. ■ . - ■ ■ r 

Example S , • ' ^ - - v. * 

An organization wishes to decide whether or not people will succeed, in a 

- • / \- . ^' 

certain job classifilcatioii. It is known from p'k^^ experiences that 40%' of all 
people who apply for this job have been successfT!^!. A screening test has now been 
developed, and It has been found that 70% of tb'i successful candidates pass t^ 
test while only 30% of unsuccessful candidates pass the fest. A new candidate 
for the job passes the test. What is. the probability that he will be successful _ 
in the job? - ' " } . 

Analysis : The candidate's probability of .being successful prior to taking the test 
is 0-4. In the light of. passing the te^, his (posterior) probability of success can 
be evaluated by Bayes'' formula (see Section 6.2, eq.. (6.9)): ^ 

^ P[Pass i Success]- P[Success] ^ ; 

PiSuccess 1 Pass] - pjpass 1 Success] P[Success] + P[Pass | Not Success] P[Not success]. 

^ ■ • ■-- ' (:7)(.4) ^ - • 



(-7)(.4)r + (-.3) (.6) 
= /61 



, Thus fjlissing the .test\ raises the probability of eventual silccess from 0.4 to 0.61. 

The general procedure for re-^stamating 'the probabilities- that vario^ states 
of nature occur is similar to the proces|^ajre loped in Example S. We assum^ that a ^ 
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random experiment has a specified set o^<outcomes A » i^l'y ^--j and that 

we know the conditional probabilities P[a]^ ' ^j^ • of a given experimental outcome 
if the state of nature J.s Sj * We theri compute the revised probabilities, 
, that ^:he state of » mature is ' s^ if the outcome pf an experiment is a^^ . 

From Bayes' theorem these revised probabilities are: , (J ' 



P., = 



At this point, we have "improved" estimates for the probabilities of the state 

■ I 

of nature s^ and can pfoceed as in Section B above to compute the .expected 
utility of decision d^ given the experimental result ^ • ^ 

m 

E[d I a^] = I U P 

Th^"^i^j^ a fixed experimental outcome aj^ , just as before, we choose the decision - 

,witii^greatest expection. ^ 
Example 9 * (Modified from Moore & Yackal) - 

Mr^T^^Smith has a congenital hearing defect, caused "by malf9rmation of the bones 
of the inne^ ear. A surgeon ^ates that an operation is available to .correct this 
defect, but the operation is not always successful. In f acl; , the operation m^ 
correct" Mr. Smith's hearing ,(si) , have no effect (S2) » or destroy the partial 
hearing which he now has (S3) . Although the surget^n cannqt predict in advance 
which of these states of nature will hold, he can, frforn extensive medical data, 
state that the probabili tie's PiVF2» P3 of these three states of nature are .9, 
.05, .05. respectively. ^ Also there is a laboratory test which can be performed ^ 
which has three outcomes A, B, C - Medical data is available which gives the' 
probabilities of A, B, t when the states of nature (discovered after surgery) are 
siy S2, S3 : . • t f > 




/ 



STATE yOF NATURE 



S3 . 



V 



TEST OUTCOME 



B 



.6 .2 



.1 .2 



.2 



.7 
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The laboratory report on Mr. Smith turns out to be B . .Mr. Smith must^decide 
whether to the operation, (dj ) or not have the operation (d2) • ^ 

After careful consideration of- the inconvenien^ces of his partial hearing loss, \ < 



the expense of the operation, and the risk of total hearing loss; Mr. Smith draws 
up the following payoff matrix whigh reflects his personal feelings: 

* STATES OyNATURE AFTER OPERATION 



Mr. Smith's Decision 







S2 


S3 




25 


-15 


. -100 


d2 


-10 


-10 


-10 

t 



Analysis : We first compute the conditional^ probabilities of the outcome B given 
si, S2, 3Xid S3 by Bayes^ theorem 



B] = 



PIS2 -t BJ^ = 



PIS3 1 BJ = 











(.2)(.9) ; 




(.2)(.9) + 


(.4) (.05) + 


(.2) (.05) 




(.4) (.05) 




C.2),(.9) + 

9 


(.4) (.05) + 


(.2) (.05) 




(.2) (.05) 





(.2) (.9) + (.4) (.05) +"(.7) (.05) 



858 



= .095 



= .047 



We;mow use these probabillirCes as the probabilities of the. state of nature given the 



L ■ ■ r 

result B of the lab test. Hence we can content e 
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Eldi 1 B] - 25(.858) + (-15) (.095) +(-100) (. 047) = 15 , 

E[d2 I B] -10(.85^+ -095 + .0A7) - -10 . « ' 

Hence on the basis of maximizing his expected utility and knowing that the lab result 
was B , Mr, Smith should decide! to have the operation- ; ' y • 

The criterion used^here is known as XihsrBxhjes ' Decision Criterion. A Bayes ' 
Decision Strategy is to perform the same computation (i,e. maximize expec^tion) for 
each possible experimental outcome and use these Bayes' probabilities to specify' 



the best decision for any outcome of the experiment 

When an experiment is^performed , it is always the case that decision Strategies ^ 
decision rules) are involved- A dec^.sion strategy is a function from tSe set 
A of experimental outcome to the set D of decisions.- Thus if there are 1 

• ' ^ ^ 

experimental outcomes and n decisions there are n possibjle decision strategies. 
This ntimber, n can^^fecome exceptionally large. For example even in the relatively 
simple ear operation problem (Example 9) n = 3 ^ and ^ = 2 is n^ = 9 . CThis is- 
to be compared with- the number of decisions, 2 • The. number of decision strategies 
Tai^>^ceeds the .numbe^Jof decisions. Hence there is tl^pOtfntial of requiring a ^ 
choice from among M things • (decision" strategies) rat"her then from among M things 
(decisions). It is,, of course, to our advantalge to try to avoid this increase in the 
niamber of possible cl^oices.^ ■• . 

In the case under consideratiqn here when utilities and prior probabilities are' 



available in addition to the conditional probabilities result^g from an experiment, 
the Bayes* Decision ''^Strategy is usually taken to be the best of the n^^possible- 
strategies. In this cas'^ the^optimal strategy is kaar^wn^and the potential increased 
difficulty of choosing ^aong decision strategies instead of among the n decisions 



<Joes not occur. The axioms for a Bayes 'Decision Straitegy Model are: ^ 



1) The set D = {di , d2, ... d } of diecisions is specif ied , - i 

n - • . ^< < 
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2) The set S « s^} of state of nature is specified, 

3) The set A -.{a^, a2-.'' . . . , 51^} of experimental outcomes is , 

specified, ^ 

* ' \4) The utilities , associated with the outcome of and s . 

' • ij i j . 

are specified. . * 

5^ The\(priG^) probabilities of each are known, ^ 

- 6) The conditional probabilities I j 1' experimental 

' ' outcome a^^ when thd^ state of natu^^e is s^ are known. 

The proceciure is then to compute P[s, | a^] from eq (6.9) and for e^ch ja^^ chodse 
the d^ so that E[d^ | a^^] is maximized." ^ 

Our flowchart is now extended as sho\irn in Figure 6.6. ^ 



GIVE THE OUTCOMES 



, , • • • , <»» 

THE EXPERIMENT 



OF 



GIVE PCs. , 
•EACH PAl4 (Sj, aj^) 



3^] FOR 



COMPUTE P., = P[a, 
BY BAYE'i THEOREM 
.THE EXPERIMENTAL OUTCOME 



FOR-" 



WHICH OCCUllS 



COMPUTE THE EXPECTED 
UTILITY GIVEN a, FOR 
EACH DECISION^ , 



SELECT THE DECISION WHICH 
YIELDS MAXIMUM UTILITY 



(stop:) 
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D.' Utilities are Known, No Probabilities Kriovyi^ but, an Experiment Is Available. 

This situation arises most commonly In statistical decision theory. -Since an 
experiment Is Involved, we must consider decision rules. Recall that a decision rule 
assigns a decision to each experimental outcome- Since we do not have prior 
probabilities, it will not be possible to reduce the selection of a decision rule to 
that of selecting a decision as in Section C. ^ 

In this case we know the values of the utilities 



and we know the conditional probaft-lities 

> 



where a^^ is an 'outcome of -the experiment. 

Let' r denote a decision rule and ^(a^) denote the decision .which r * 
assigns to the experimental outcome a^ , e.g. . 

w 

Then ^or ^ach decision ^^^^ each state of nature s, , we know a utility 

U(r(aj^), s^) (recall r(^) is some particular decision).. Si: ,3 the probabilities, 
P[s I a.\] are known, we may average out the experixuenta: outcomes and ^^slgci a 
utility for the decisxon r*ute ' r which is independent of zhe particular c:cperimental 
outcoiae as follows 

U(r. s J = .U(r(a^). s^) . P[s^ | a^] 

We have now Eliminated the outcome of the experiment and have only utilities. 
However, the utilities are for decision TuZes\ rather than utilities for the 



ecisions- Thus we have reduced the problem to the case of decision under uncertainty 
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as treated in Section A, and creterlQ^ ^^^^x as Maxi-Min utility may be used. 
Notice, however, that what we wlH ^^o^^ce is a rule for making a decision, not 
the decision itself. . , 

For a fuller treatment of this Cg^^ in statistical decision theory see Mood, 
Graybill ^nd Boes , in particular PP- 297-299, pp. 350-351 and pp. 414-416. 

Our flov chart ffe continued ^.s s^i^^ in Figure 6.7 



GIV^: tfjCPtRIMENTAL 
OUTCOMES af, az , .... 



FOR EAc^j pair (s^ , 3i^) 



Jiach rule R 

U^Ell CONSIDERATION 
^°^tJT:E U(R, s ) 



J^igure 6.7 



E. No Utilities or Probabilitie^^^B^Qy^ but an Experiment is Available 



The case when only an experi^^^^t ^^ypically taking a random sample) is available 
is the subject of classical stati^^ic^^ In this situation one adopts criteria such 
*as the principle of maximum liklil^^o<3, ^nimum variance — unbiased estimators, arbitrary 
confidence levels, arbitrary size of type one error^ in place of the missing utilities 
and/or prior pr^b^J^lities to eval^at^ decision rules. The flow chart continuation is 
shown in Figure 6.8. 



ERIC 



-, Figfire -6.8 



Fr Ko Utilities Kaown but Probabilities are Known and an Experiment is Available. 



H«e*we can use Bayes' theorem to refine our knowledge of the oprobabilitie^ and 
hence reduce the problem to' one in whi-ch there is no «q>eriment. Thi^ case is 
considi^ed in the next sub-section - G. The flow chart addition ?iLs given in^ 
^Figure 6.9. .'^'^"^'^ / . - ■ 



REVISE PROBLEMS USING 
BATES ^ THEOREM 



3) 



Figure 6.9 



er|c, 
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' G. No Ptilitties;RQoyn and No Exg gj rjment is Ayailable, but\Probabilities ase' Known. — , 

^ :•' • * • - ' . ' ^ • ■ ) , ■ ' ' 

. Here.*tto global rules can be. given, put the general advice to, "behave as if the * 
most likely state of naturie^ is in fact certa"in** may be helpful. We reference Mood, 
; Graybiil & ^oes pp, 340-343 for ^ example involving point estimation. Additional 

. ' ' ■■ . . • ' ' . ^ 

.examples when this criteria is usef^^l occur whenever, the decisions are of the form: 

; ■ _ . . ^ » " 

= assert ^ s, is the true stat^ of nature.. The flow chart'^ coi^inuation is given 
in Fl-gure .6.10. ^ ' ' ^ *v ' . ^ 




HAVE PROBABILITIES OF 
STATES OF NATURE 



YES 



ClQ) 



ACl A3 IF THE MOST- 
LIKELY STATE OF NATURE 
IS CERTAIN TO OCCUR. 



Figure 6; 10 



H. 



Nothing is Known . ' 
Our only advice in this case is to, guess! See Figure 6.11- 



ft 



NO BASIS ^FOR 
bECISlON EXISTS 
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Figure 6.11 



■ -"lb ■ 



***************************** * *, ******** *a 



Tnterterm Project. 



^Piece together the flow chart developed in this section (Figures 6.1 to 6.11)' 



• 1 



4 



to give a conij^ehensive set of rules for decisioii making. • * 

***'*>-* **;)*******/* * * ** *******'*'******** ***"*** * - 'A^^' 



\ 



■ </■:- 



> 
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'> ^6>4 Iferkov Chain Hodelg, 



: We will begin this fixial topic of Chapter 6 by. presenting ^ simple demqgrap^j^ 

* model in. a form suitable for use in ^.matrix' theory course* In order to do this J 
' -we will teii5>orarily avoid the nomenclature of probability "theory and use a sligh^^^'^ 
non-standard notation. 



We consider the movement of the, population of the United States Our model 
will be over-simplified, but the generalization to a more realistic model should x) 
apparent. . • 

We divide the naticfn .ijato four regions: East>- Midwest /Mountains and West, 
Suppose that" in any g^^^^^n year one -half of the population in the East remains tlj^^^;^ 
The other half moves as follows: 1/12 of the total moies to the Mit^est, 1/6 mov^^ 
to the Moxjntains and of ^ the total moves to the West» Notice that 

1/2 + 1/12 +1/6+1/4-1 



,.£a<^us the entire population .is accounted for. We can' express this movement as a 
ciHumn vector 



(6.11) 



TO 



East 
Midwest 
Mountain 
West 



FROM EAST 

1/2 ' 
1/12 
1/6 
1/4 



t 



Now suppose wa^ hav^ the similar column v%:tors for the Midwest, Mountains a^^^ 

-West ; ' * ' ■ • — « 

mO!A ■ ,, FROM . FROM 

MIDWEST ; MOUNTAINS • , WEST 



V 

"rf- 



(6.12) 



. 0 
1/2 
1/4 
1/4 



0 

0 
3/4 
1/4 



. r 



1/4 
0 

'-1/4 
1/2 



Note that the sum *q£ the coxnponents of each of these vectors is 1 
these movement vectors into a 4x4 table: 



We can- combine 



(6.13) 

TO: 



- 


FROM 
EAST . 


FROM 
MIDWEST 


FROM 
MOUNTAINS 


' JFROM 
' WEST 


EAST 


. 1/2 . 


.0 


0 


1/4 


MIDWEST 


1/12 


1/2 ' , 


0 




MOUNTAINS 


' 1/6, 


1/A 


3/4 


1/4 


WEST 


1/4. 


• 1/4 


■ 1/4 


1/2 



We can raise some ^interesting qtiestipns regarding the movement .of population 
In^) lied by this table. 'Pot example:, - ^ - . 

- 3 ■ ' 

a) Given some initial population distribution/ what is the - 

population (j^^stribution after th^ f^rst year? , ' 
.... b) Assuming that the moveja^nt^ is the same for the second year, 
^' then what the population distribution after the second 
year? ^ 



c) What will the "long^ rto" population distribution be if this 
pattern of movement continues indefinitely? 

d) Is there some population distribution which will be imchanged 
'by the movements discribed by the matrix T^,? 

Assume then that . the initial -population is 3/4 in the East and the remaining 
1/4 in the Midvtest (as in the early days of the nation's development). Hence t^ie 
original population may be represented as the colximn vector 



(6-14) 



FO 



'3/4 



1/4 
0 



, 0 , 



EAST 
MIDWEST 
MOUNTAINS 
WEST 
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^ Compute, the proportion of the po|)ulation in the East after the first year^ 

we obset^^ from the first rbis^of out table and our population vectl>r Pq that 

• t ' . . ' ' " ' ■ 

.1/2 3C 3/^ regains in the Easlt, 0 x 1/4 move from the Midwest to the East, 0x0* 

move froi^ the Mountains to the East and" 1/4 x 0 move from the West to the East, - 
hence a total pf 

1/2 X l3/4 + 0 X i/4 + 0 X d" +. 1/.4 x 0 = 3/8 

' - ' U ' ' ^ ^ 

are in tij^ ^^^^ after the first year. 

' ^^"^larly from the third row of the table 



1/6 X 3/4 + 1/4 X. 1/4 + ,3/4 x 0 + 1/4 x 0 = 3/16 , 

\/[ - J ^ ■ ' . 

are id Mountains after the first ^year* * ' 

Th^Q^ calctilations clearly correspond to ordinary matrix multiplication, where 

we ^^ons^tirug our l:able as a 4 x „4 matrix. Thus denoting the population after the ^ 

first pe,.^^^ Pi , we have' ' . 



(6.15) 



Pi. - 



1-/2 " 


0 


0 1/4^ . 


1/? 




^3/8" 


1/12 


1/2 . 


0 0 


1/4 




3/16 


1/6 


1/4 


3/4 1/4 


-0 


; ; ( 


3/16. 


^1/4 




■:i/r 1/2," 


T o 







which ag^^^g with and extends our previous calculations. 



letter**' 



(6-16) 



s answers 'question (a) • For brevity^ let us denote pur 4x4 matrix by the 
t . Then a symbolic vejrsion of our above result is . 



Pi ='T Po 



^"^^h this ^o^^tion it is easy to answer our second question; Denoting the 
populati^^ vector ^ter the second' year by P2 and assxming the movement matrix T 



remaxns 



the saice> we have 
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(6.17) 



P2 -'TPi 



1/8 

5/16 

5/10, 



"I 



We coTild also compute P2 as follows, taking advantage- of the fafct that 
matrix multiplication is associative: ^ . 



(6.18) 



~ P2 = T Pi = T(T Pq) = T2 Pq - 
Similaarly we find, for the population vector Pj^ after . years 



(6.19) 



P, = T Po 



' These results answer question (b) and its generalization to k years^and also 
shed some light on question (c) . For from (6M9) , we see that the "long run^ behavior 
is closely bound up with the behavior of T . Tor large k . 

A BASIC program to successively compute Pj, P2, P30 £^om 



and to. print every tenth res 



T P, 



k = 6, l,\y 



IS 



Iff 
20 
30 
40 
50 • 
60 
70 
80 
90 
100 
1 10 
120 
130 
,140 
150 
1^0 
I 70 . 



DIM T(4,.4)>X<4* l )*rC4, I ) 
MAT REAL) rC4,4) 
MAT kF:AD XC4# 1 )3 
F3K J= 1 T3 3 ; . ' i. 
F3K K=l Ta 10 
MAT r=T*X 
MAT X=Y 
.NJEXT K <. 
r^KlNT 
•MAT PKINT>X . 
NEXT J 

DATA .5*0>0*.25 
DATA . 0833333* . 5*0*0 
DATA . 166667i .25*.75*.25 
DATA .25* .25* .25> .5 
DATA .75*. 25*0*0 
.E.MD 
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llie result of running this program is 



. I ^AV 1 1227 1 ^ 
.023S100V612 
.-67124620*^73 
.•333333254 19 



0* 1 6666709 1^ 
• 027773907S3. 
.472221S/I574 
•33333373890 



. 1 6A66693635 

• 02^^777;^^ 1027^ 

• 472223 131 1^5 
•33333390557 



Notice t-at the population vector appears to be settling down to some unchanging 
vector:. The iinplication is that this vector will be the answer to question (c) 
above. 

Before pursuing question (c) further, however we answer question (d) in the 
affirmative by producing a vector which remains unchanged. Consider an initial 
population vector of * . ' 



(6,2<)) 

Then 
(6.21). 

and hence 
(6,22-) » . 

. Now 



1/6^ 
1/36 
17/36 
1/3 



Pi = T = P, 



3 = TV 

■k E 



k -,1, 2, 3/. . 



if we "compute successive powers of the matrix T , we will find that the 



resulting matrices tend towards the following matrix 

1/6 



(6.23) 



E 



1/36 
J.7/36 
1/3 





^ 1/6 ' 


' 1/6 


1/36 


1/36 


1/36 


' 17/36 


17/36 


17/36 


,1/3 


■ 1/3 


1/3 _ 



Notice that each column of T^ is^ identical with every other column and in turn is 
equal to the vector P„ which remained fixed. _ Notice also that' -J , . 
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» » 

for ccnxj colTimn vector Pq which consist^ of positive components, summing to one. 
Thtis since - . . / \ 

(6.25) ' ■ T_ as k -> » \' 

we have that 



9^ 



• ' ^ k V * 

(6.2,6) = T*^ Po ^ Po = P|. . ' . - 

' - . . / ' ■ . ' [ 

Thus question\(c) concerning the long rim behavior is settled for the particular 

matrix T given by (6.13). Let us note that tHere ^as' no need to pull the vector P„ 

> *^ E 

"out of the hat". I'f we seek a vector which is unchanged (fixed) by T , we 

, have the equation 

(6.27) > T Pp = Pp . • . - 

or ' ^ 

(6.28) ^ .(T - I) Pp = 0^ ' ^ ^ 

•t * 
where I is 4x4 identity matrix. 

\Sihce the equation is homogeneous ^ we have either just the trivistl solution or 

Infinitely many solutions. The latter situation obtains and since we demand that the 

components of P^, sum to one, we^ can pick a unique population distribution vector 

from the infinitely many solutions of (6«28). Thus the material, at hand serves as 

, application of the usual linear equation solving that is performed in linear algebra 

courses. . 

• A BASIC progrsun to form eqs. (6.28) , replace the last equation (which in this 

case is^ dependent upon the others) by 

. • * - -J . ■ 

- P1-+ P2 + P3 = 1 . ' . 

Er|c . . . 2lZ . 



and find the unique solution of the restilting 4x4 system is 

10, DIM TC4j>4>,IC4*-^')*RC4*4)*XC4*1)*BC4* I) 
100 MAT KEAD T 
1 10 • MAT I = IDM 

120^ REM ** SOBTKACT 1 FR0M DIASaNAL 

MJAT T=T-I ' ■ . ' 

REM ** PLACE ALb I'S IN LAST R3W. ** -r ,. 

FiR K=l T0 4^ ^ J ' - ' ■ 

LET TC4*K) '= 1 / ' 
MEXT K ' ■ , ^ ' 

REM ** PUT ZEK0ES -3N' RIGHT- SIDE EXCEPT F0R LASt R3W ** 
MAT. B =• 2ER , — ^ 

LET B<i4* 1 ) = 1 ■ ' 

REI^ ** C0MPJTE AND PRINT S3LUT.I0N ** 
MAT R = INVCT) . 

MAT X = R*B ^ * ' 

MAT PRINT X ■ ' ■. 

DATA . 5*0*0* .25 

0833333* .5*0*0 ' .. . • 

166667*. 25*. 75*. 25 - 
25*. 25*. 25*. 5 - ^ 



130 
140 
150 
160 
1 70 
180 
190 
200 
210 
220 
230 
240 
300 
.310 
320 
330 
400 
# 



DATA 
DATA 
DATA 

end' 



/ 



If we run this program the results are : 



. 1 666A663333 
.027777761 1 1 
.47222233889 
.333^3326667 



Noticfe that this is" the vector P_ given in equation (6.20). 
In any case we find that 
6.29)^ ' ' = . 

is our particular numerical example given by (6 . 13) . That is , the vector which is 
"fixed" is the same as the "equilibrium" on "liMting" vector. 

Before enmciating any general theorems, let us investigate some different T 
matrices.. First consider a model in which the country is divided into two. parts: 
East and West. Suppose that all of the people in the' East mi5ve to the West after 
one year and vice versa, then 



(6.30) 



T = 



and 
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• t2 



■t: :i 



' Thi2S the colmpas-^f i do not become identical in tlHLs case and as a consequence 



Pj^ does tiolii approach a fixed vector- For example, if 

■'•'■[:] ^ 



Then 



■[;] 



P9 = 



and so on. Thus thereNis no vector^ - which arbitrary Pn's will approach. 



However, there dDs^ fixed vector 

■ " • \ 

(6-31) 



As a. third example, let there be three regions: East, Midwest and West. Of - 
those in the East, 1/2 stay there and 1/2 move to the West. All of the people in the 
Midwest stay in the Midwest -^""Nlf those .in the West, 1/2 move , to the Midwest and 1/2 
stay in the West. Then T becomes * 

' 1/2 0 0 
(6.32) T - 0 11/2 

_ 1/2 0 1/2 J 



We find in this case that 



0 
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t2 = 



. T 



a = 



'l/A. 


0 


0 


1/4 


1 


. 3/4 


1/2 . 


0 


1/4 


1/16 


0 


0 


11/16 


1 


15/16 


4/16 


0 


1/16 


1/256 


0 


0 



247/257 
- 8/256' 



1 
0 



255/25« 
1/256 



Thus it appears that 



.<6.33) 



"0" 




0" 


1 


I 


-1 


0 


0 


0- 



and 



(6.34) 



btice that all of the population is eventually ^'absorbed" into the Midwest region. 
Rather then say . 1/2 of the population in the East moves to the West in any 
given year, we could have said that for any person in the East, the probability that 
he will move to the West is 1/2 -.'^Had we done* so, we' would have been led to the 
same matrix equations and the same general results regarding equilibrium and fixed 
vectors. Thus we now turn our attention to stochastic matrices (we can think of 
(6.13) as one such matrix) and Markov chains ♦ _ 

erIc 



' ' ' 

We will careftilly state the axioms for the Markov Chain Model using the v 
standard probabilistic nomenclature and notation. We then will give some general 
theorems about Markov Chains and finally cite some additional examples which 

^11 

make the wide scope of applicability of this>/model more apparent. 
The basic assumptions of the Markov Chain Model' are: 

1) There ^exists a sample space, consisting of a sequence of trials 
(eg. the population distributions at periods 1, 2^ 3, ...), 

2) The outcome of each trial is one of a finite set of stktes 

si, S2, , s^ (e-g-. East, Sidwest, Mountain, West) with respective 

probabilities > P2 > • • • > » ' 

3) The probability of each outcoEde s^ depends upon the outcome s^ of 
the immediately preceeding trial, but not on the earlier trial^ (e.g., 
the probability of a person moving to the East depends on whether the 
person is ncfW in the East, Midwest, Mountains or West but not on where 

„ ^ _ he was earlier). The conditional probability of s. given s^ is 

^ denoted by t.. . 

ij — ^ 

We make two helpful definitions. A ■proBabll'tty vector is a vector (pij , p^) 

whose components satisfy 

i) 0 £ p < 1 * 
(6.35) ^ 

ii) Pi + P2 + Pn " ^ 

In the population movement example, the component p^ represents the probability 
of being in state i (or the proportion of the population which is in state i ) . A 
trccnsitian matrix T is a matrix whose rows kre probability vectors. In the 
population movement example the component t^_. of a transition matrix represents the 
conditional probability of transition to state s- at the next trial, if the current 
state is s^ (or the proportion which will move from state i to state j at the 
next triaio . 
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CAUTION: In adopting this interpretati^^ t (as is standard in the social 

sciences) we are dealing with the *^^^Po5^ of matrix used parlier - in partictilar, 
it is now 'the raws of T which will su^j^ one • - 

We trust that the above remarks ^e^^ to make clear the notation and the two 
possible interj>rertations of the Markov Ct^^^n model, and henceforth we confine 
ourselves to the probabilistic intetpre^^^-j^on. 

The key result of Markov Chain "^eo^ is the one obtained earlier.* 
Theorem 1: <^ If the initial prob^bil^^^ vector is Pq then the probability vector 
after k trials is given by 

Corollary: The conditional P^^'^^^^ility that a system is state s initially 

^ • ^ k 

is in state s. ^ after k steps is S^v^^i by the (i, j) element of T . 

We now tumi^o the investigati^^^ Of ^]^e long-run behavior of a Markov Chain. ,A 
Markov Chain with j^ansition matri^c T said to. be regular if 

, Tg k - . 

where T is a matrix each of whose ^oi^^ consists of ■ a aommon probability vector 
• . E - 

e =• (e^, e2> •••> with posit^'^^ ^-^^e.? zeros) components. 

Recall that of our "three popul^^iot^ ^jiovement .matrices (which now must be . 
transposed) only the first corresponded ^ regular chain. The second failed to be^^ 
regular since T^ did not exist, and t}^^ third failed because e- = (0., 1, 0) had 
zero components. The vector e_ ^^Xxe^ equilibrium or stable vector. 

Theorem 2 . T is regular if a^^ oni^ if there exists a power r such that. T^ 



Technically, we should check that \ actually a probability vector, that is, 
satisfies (6.35). 

o 2 J " 
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has all positive (i.e. no zeros) cbmponents. 



Proof: " That regularity implies the existence of r id' ' lUlliiuliate (recall Tg 
ha s no z^oes in this case)* The converse is fairly tedious, se^ e.g. Kemeny, 



Snell & Thompson or Maki & Thompson. 
* 



Theorem 3: 



Let T be the transition matrix of an n-state regular Markov Chain 



r " 

\and let r be the smallest power such .that T has all positive elements, then 

.' * ' 

/- ■ - . 

(6.36)' ' . - r<,(N-l)2 + l 

Theorem 4 ; If T is a tr>ansition matrix of a regular Markov Chain then the 
Stable vectoi^^ e satisfies 

k 

i) p P e for any probability vector p 
ii)V e P= e (i.e. the stable vector is a fixed ve&tor) . 



Note that Theorems 2 and 3 allow us_ to decide if T is- regular while Theorem 4 
pari; (ii) tells us how to compute e . If any power T^ has all positive elements 
thetj^^rf^is easy to see that all succeeding powers Jiave all positive elements. A 
fLoD chart to decide whether P is regular is given in Figure 6.! 




*Rcference: M^£i & Thon?>son cite this result, on p. 101 without proof. 
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DJPUT N, T 



I 



R = (N - 1) 2 + 1 



-R = 1 



T -f- T*T 




PRINT T IS REGULAR | 



(STOP ) 



NO 



NO 



K = K + 1 



PRINT T 'IS NOT 




( STOP ) 



V 



Figure 6.12 



Alternatively, we could test t 



. . > 0 after each iteration. If ^^''^^'''^ - ^ turns 
13 



out to be regular, we can compute the stable vector e by solving 



e T = e 
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stabject to ^ 

n ■ ■ 

by a Gaussian ^lemlnation routine. ' ' 

• * * «• 

^ We now eite some of the better known results for non-regular chains' (again 
Maki & Thompson and Kemeny, Snell & Thompson gi,ve. proof s and /or discuissioris) . A Markov 
Chain is evgodic^ if for every, pair of states s^ and , there exists an integer 

r ' such that a transition from to s^ has positive proBabili^ty (i.e. the (i, j)^^ 

of is positive for some r - which now can depend on i and 3 ) • The ergodic 

property means that we can get from any state to any other state in a finite number 
of*trials. 

Of course, a regular chain is always ergodic since for regular chains there 
e^cLsts an r which works for all pairs of states simultaneously. HoT^ver, there are 
ergodic chains which are not regular, for example, our second popxilation movement ^ 
matrix ' 



[i o] 



Here we can set from state 1 to state 2 and from state 2 to state. 1 in only 
* ■ 

1" step, while the transitions from state 1 to state 1 and state 2 " to state 2 

take only 2 steps. Hence T is ergodic, but not regular as noted previously. 

> . 

Theorem 5 : Ergodic Chains have a tmique fixed vector, e = e T , where e i^ 

a probability vector. ^ ' L 

Note that now the unique fixed vector is not necessarily stable vector. 
In the above example e = (1/2, 1/2) but ^ T^ ^does not converge, hence T^ Pq will 
not converge (unless Pq = e) • However, the components of e ^do have a useful . 

interpretation: if- e = (ei, e?, ...» e ) then e. is the long = run average 

. ' - i' c' ^ n .1. 
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probability of being in state ^± * ^ ^ 

Finally we briefly consider dbsoThing ohcd^ns. The. state s^* of a Markov 
Chain is an absorbing state if t^^ ^^I . A Markov Chain is said to be an absorbing 
chain if ^here exists *at least one absorbing state and if transitions from each' 
non-absorbing state to SOTz^ abs cubing state are possible in a finite number of steps. 

• ^ chird population movement matrix (now transposed) provide^ an example of an 
absorbing chain. As we saw then ^ ^ * • ^ ^ 



0 i ^ 0' 
0 10 
0 1 ,0 



which iii?>lies 'that eventtially we enter and remain in the absorbing state 
with projb^ability one. - 

This behavior *is typical, in fact If we^write T in the Canonical fo^u (by 
Reordering the' states if necessary) 



T = 



m 



, I = m X m identity T&atrix 
* m 



then 



m 



1 
'J 



where 



R = R + Q^"^ R . 



Theorem 6 
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' This theorem ™>OTg that we enter= an absorbing state with probability' one . ^ 
Theorem 7: 



N = (I - Q)"^ exists and n^j is the expected number of times that 



the system is in state s. given that it started in state s^ and continued xmtil 
absorbed. 

We turn now to some additional examples of Markov Chains. 
ig^raifipie 10 : A Learning M^del for Simple Tasks (modified from Maki & Thompson) . 

We assume that such learning is all or npne and thus there are odly' 2 states 
"learned" and '"""ignorant " . We assume that the subject is "taught" in a sequence of 
gleaming -sessions and that the probability of learning at any given session is c , 
where 0 <^ c < 1 . We assume that" forgetting never takes place - that is once the 
STibject is in the "learned" state, he ^remains there. * ; 

Ai^alysis ; If we denote "learned", as state one and "ignorant", as state two, then our 
assunqjtions lead to the transition matrix. 



T = 



[c 1-cj 



and the initial probability vector-, 



Pn^- (0, 1) . 



It is easjr to see that- 



1 0. 
1 - (1 - C)^ (1 - C)^ 



and hence if we denote the ptrobabil;Lties of beixig in states 1 and 2 at time k 
by the vector P^^ -, we have . . 

' \ = ^0 = a-(l.-C)\ (1-C)^) . 
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One consequence of our model is that the probability of learning at or before the 
k^^c trial is 1 - (1 - C)^ 

jSxajgple 11 ; Another Learning Model (from Doxn) . ... 

In this model we assume that learning is gradual. Specifically we assume that 
. iii each trial, the subject learns a proportion . A (0 <.'A < 1)^ of the unlearned 

' material. Again we assmoie the subject is. totally ignorant of the material initially 

< 

Aaalysls : Here the states have not been defined and a moment's reflection reveals 
that there are infinitely many states of partial learning. Hence the Markov Chain 




Model does not apply. An appropriate model is the difference equation 

where denotes the proportion of material learned after k trials. The solution 
of the Equation is ' - - 

Lj^ = 1 - (1.- Lo).(l - A)^ . 

Moore & Yachel, p. 65 ff present still another learning model which involves 
two'-rstep' learning. ^ 
Example 12: CMalkeyltch & Meyer) 

^ electric power company, checks its main? generator' once each quarter year to 
forestall blackouts due to equipment failure r Assume there are t;w6 outcomes,' 
W = generator needs no repair, D = generator is defect:ive and needs repairs. 
•Repairs will be made only in State D. (It is ^natural to suppose- 'that the transition 
D -is rare and W ^ D more common). Assume that if a -given inspection yields 

W rhen the probabilities that next quarter's inspection yield W or D are .6 
^arid .4 respectively,, while if the current . inspection yields D then these ^ 
probabilities are .9 and .1 . 



22 



Analysis': The transitl^ matrix is 



FROM 



W 

D 



W 

.6 , 
.9 



D , 
.4 
.1 



which is clearly regular. The Markov Chain assumptions are at least plausible here. 

Example 13 ; (Kemeny, Snell & Thoinpson) . 'In predicting long term ^trends in 

Republican - Democrat transitions taking into account only the prior state 

■ ^ . • . - . 

(Republican or Democrat) , one would use a transition matrix of the form 



R 
D 



R 
1-a 

• b 



. D 
a 
1-b 



vhere a is the probability of a change from a Republican majority to a Democratic 

majority (estimated from historical records) and b is the probability of the 

> 

opposite transition. A refinement which allows a little additional past history to 
be used is to consider the last two year*s resiilts - i.e. the states are now 
RR, DR, RD, DD where for example RR means voted Republican the last two times. 
The transition: matrix now has the form " . - - 





RR- 


DR ^ i- 


ED 


DD 












RR 


ri-a 


0 


a 


'0 


DR 


b 


0 


1-b 


0 






1-e 


0 


- -6 


\ -DD ' 


. 0 


d ■ ' ■ 


0. 


1-d^ 




Note that certain transitions are now .impossible. This device of enlarging 
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the set of states is commonly employed to partially circumvent the Markov 
restriction that the transition probabilities can only depend on the current state. 
Other examples abound: transitions between parents social states and child's 
social states; transitions between job catagories; transitions between physical 
locations; all can often be approximated by the Markov Chain Model. A particularly 
intriguing model of small group- decision making is presented in Maki & Thompsotf 
p. 81 ff. . , 
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AUTj-lORS \ EVALUATION 
(Elense circle one of the responses to each question) 

1. Did you attend the short course in 1974-75?, 

2. Is this chapter 

^ (a) Too short * . 

(b) Too long \ ■ ' 

(c) About right . / 
Id be expanded? - ' 



\ (c) About ri 
If (a) , which topics shou 



er- . ''No 




can you suggest topics to be added? 



If (b) , which topics should be abbreviated? 



whii:h topics should be eliniinated? 



3.. Could yoq read and understand the computer programs? 



4, 
5. 

6. 
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(s) . alt^ys - 

' ' Cb) sometimes . « 

■" J . - . . ■ 

Did the interim projvacts seem reasonable? ^ 
Were the self-study problems 

(a) Too easy 
Was the number of self-sttidy prolDlems 

(a) Too large | • 

. (b) About right 

(c) Too small 



(c) 'seldom 
(d> -^lever - 



Yes 



(b) Too difficult 



22 



• No 



o 
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?• Did you attempt any of the self-study problems? Yes^ No 

8* Are the solutions to the self-study, problems ^ , 

properly placed (on overleaf from problem)? Yes No 

If no, where would you suggest the solutions be placed? 



9. Por each topie, how solid an understanding do you think you have? 

Excellent Good Fair Poor 



Binomial model 
Poisson model 
Bayes^ Theorem 
Decision Theory (in general) 
Maximum strategy 
Mini-max regret 
Maximum Expected Value 
, Use of posterior probabilities 
Markov Chains 



\J 



\ 
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DIFFERENCE EQUATIONS 



In this appendix we will discuss linear difference equations with constant 
coefficients. We will fcind the general solution of such eqxiations when the equations 
are of the first and second order and have constant coefficients. A fuller discussion 
as well as a discussion of more general types of 'difference equations may be found 
in IntiK>6MCtion to Difference Equations by Samuel Goldberg (Wiley, New York). 

PART I - LINEAR, FIRST ORDER DIFFERENCE EQUATIONS 

' 1«1 Definitions of Difference Equations and their Solution 

The equation * . • 

Cl.lh ^1 ^k+l ^° " ^ . k = 0, 1, 2, . . . . 

where ^0 and ap ¥p is a linear, first order difference equation with 

constant coefficients. A solution of (l.i.) is a function y^^ defined over the set 
of non-negative Integers (k =0, 1, 2, ... ) which reduces (1.1) to an identity. 
For a given value of yo , (1-1) has a unique solution. 

As an example consider , ^ . 

■ • 

2yj^l - ^k = ^ • _ .>. 

For yo = — 1 the function . ^ * 

yj^ = 1 - (1/2)^-' 

Ts a solution because 
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2yicfl - = 2 - 2(1/2)^ - 1 + (1/2)^-^ = 1 



for all k . 



-y - - 

Self-Study: Problem #A.l 

Match the difference equations on the left with the solutions on the right. 

(a) .(k + 1) Yj^^j + kyj^ = 2h - 3 (i) = (k(h-l) ) /2^ 

(c) y^i - '^yy, = 3 , (iii) Vy, = l^" (2/k) 




a 

^ 8-A.3 



Solution to Self-Study! Problem M.l 

(a) - (iii) 

(b) - (i) . . 

(c) - (ii) 




\ 



> 



< 




1,2 Solution of First Order Equations 
Rewrite (1.1) as 



An 1. ^ 

7k+l- . ai -^k ai 



or 



(1.-2) yi^i = M^ic c . 

where M « - ao/ai and C = b/a^ . Notice that M ^ 0 although "C may Indeed 

vanish. Then - 

X . ■ 

yi = Myo + C • • . 

and 

72 = Myi + C = M(Myo + C) + C' 
, . = M^yo + C(l + M)- ■ _ \. 

Then . 

■ ^ 73 = My2 + C = M<M2yo + C'(l + M)) + C ' . ' 

= M^yo + C(l + M + M^') . -1 

Thus we might "guess" that ' ■ / 



= yo + C(l + M + 1^ + . . . + M^"'"' 
But ' I 1 - 



1 + M + M2+ ... +M^ ^ = 



1-M -^orK^l 
k ^ for M = 1 



so 



231 



1 *•« 



1 - 1^ 

M 70.+ C §■ for 1 



1 - M 



yo + k C 



for. M = 1 



or 



(1.3) 



yk = 



+ k C 



for M - 1 



To verify that (1.3) is indeed a solution of (1.2) substitute the function defined 
by (1.3) in (1.2) and show ; that <1.2) is reduced to an identityl / 

_ ^ ' jf- _ _ _ ^- ■ ; _ _ _ 

Self -Study: Problem #A.2 

Find solutions for the following difference equations 



- Tk - 2 ? ° 
y^-i = yk 



^fc^i * ^k 



(d) 4y. 



k+1 



(e) y^i.-2yj. 



1 

- ^k = 2 
1 



(f) 



yjef 1 = ^^k 



70.= 1 , 
70 = 2 
70 = 2 - 
7r =3^ 
70 = 2 
70 =- -2 
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SABT n - uhear^ second obder diffebe^ce equations 



2«1 Diefioltlons 



The mcist general-vsecond 



order lineaf difference equation witli <-i?^st:ant 



• coefficients may be * written 

(2.1) ' ay^^ + by^l + cy^ = d k = 0. 1, 2, - 

labere 0^ and cg^ O.. 

Tor given values of yg and yi , (2.1) has a uniqije solution. ^^^^tion is 

. •'■ ' ■ ■ • ^ ■ ' ' . ^ , ■ ^ 

the sum of the general solution of the homogeneous equation 

■ ' ^ ' '^'^ > 

^' ■ • • '. ..--y^'*" ■ 

.(2-2) - ayj^^ + by^^ + cy^^ = 0 k = 0, 1, 2, "V 

and a particular solution of (2.1). The general solution of (2.2) ^ ^ Particular 
solution of (2.1) are discussed below. 

2*2 General Solution of the Ho^geneous Equation 

— - The general solution of (2.2) is" found from the roots of the ch^'^^^^^^istic - 
equation. 4^ . 

* ax^ + bx + c = 0' . ' 

Case If If b^ - 4ac > 0 , then both roots ^e real and unequal- 'ii^^ 

, ' ! ^ b + /b^ - 4ac : . - b ^ Vb^^^T^ ^ 

The ^geneTTtal solption of (2.2) then is 

" ' " ^|. y^. 7 A(Xi)^ + BXXz)^ ^ _ 

idier.e -A and are constants to be determined from the initial (ic((^^^^^°^s 7q 
and yi • 



Solution to Self-Studyf • Prablem #A.2 
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V (a) M = 1, C = 2 so from (1.3) 



71, = 1 + 2k 



(b) M = 1, C = 0 



so 



(c) M =-1, C/(l-M) = 1/2 so 



= (3/2) + 1/2 



(d) M = 1/4 , C/(l - M) = 2/3 



yy. = (7/3) (1/4) + 2/3 



(e) M = 2, C/(l- M) = -1 



y^= 3.2--1 



(f) M = 5, C/(l - M)' = -2 



71, = -2 
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1,3 Behavior of the Solution^ >^ 

Secall first that H ^ 0 . We will consider twa cases: M < 0 and M 
^(i) If M < 0 , the solution oscillates. The amplitudes of iThe^ oscillations 
Increase as k increases if M < 1 • The amplitude is constant if M = — 1 
and the amplitudes decrease if 0 < M < -1 • 

(ii) For; 11 > 0 "thetf if 0 < M < 1 , the solution decays exponentially* If 
M » 1, the solution is linear. If M > 1 tjie. solution grows without • bound. 
Notice, that for K ^ 1 xf 

\ = C/(l -^M) . . 

. ■ ■ - ... . , \ 

the solution is a consta9rt. ' « \ 

■ ■ ■ ' • i I ■ 

Finally we note that for Im( < 1 then the solution approaches C/(l - 
for large k . _ , . 



Case ,11: If - 4 ac = 0 then "both roots are real and equal. They are - ' 

■ ■ ■ . - . ^ 

^ ■ . " ' X = - b/2a . ^ ■ .^.fi'' 

In this case the general solution of ,(2.2) is ' 

C^se -Illr If b - 4ac < 0 then both roots are . imaginary- and are complex conjugates. 
The roots are . * 



V, - ^ + ^ /4ac - b^ ' : • b ^ /4ac - b^ 



Let 



r = /c/a 

9 = cos"^ (b/2i/ac) 



Then^the general solution of (2.2) is ; ' ^ 

■ ■ • - -.■■-•';>■■ ■ • ■ ■ 

• ' ^ y^^ = A' r^ cos (ke + B) r. ' 

wfiere <again A and B are constants to be determined from the initial conditions 
yo 'and\ y^ . • . . ' 

2.3 Particular Solutions ^ 



To find a particular solution of (2.1) where d is a constant there are again 
three. cases. y - - . 



Case I: If both roots of the characteristic equation are real and distinct and . 
neither root is 1,, i.e., Xi =^ X2 and 1 and X2 1 • then \ 

* • y^. = d/(a +Jb^+ c) 



FRir 



.Case II: If both roots are distinqt and real but one, say Xi , is 1 then 
. b « -(a + c) • The general solution is 

The particular solution is of the form . 

... I . ■ 

V / - • 7^ = dk/(2a + b) 

Case III: If both roots equal 1 , i.e; , = A2 = 1 > then b = -2a and 
The general solution is , - 

7^^ = A + Bk ^ _ 

. Both a constant and, a constant times - k are included in the general solution. 
The particular solution is 

2«4 Examples ' • 

The characteristic eqiiation is 

. + X - 6 = 0 

'■• ' . - ■ •■ ^ •■ ■ ■ ' ■ . - 

whose roots are = 2 , ^2 = -3 so the complete solution is ' " ^ 

y, = A(2)^ + B(-3)^ - 1 

If the initial conditions ^ are ^ yo = 2< and yi = 0. then - • 

\ k+l k 
^k ° + (-3) -1 

ERIC - 23? 
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The characteristic equation is 

x2 + 3x - 4 = d ' 
whose roots are Xi = 1 , X2 = -4 . The complete solution is 

y, = A + B(-4)^ + 2k 
If the Initial conditions are yo = 0 and yi = 7 then 

y^ = 1 - (-4)^ + 2k 

E^l^ 3: y^^2 - ^^k+l ^ ^k 

/ . .■ 

The characteristic eqxjation is 

'x2 - 2x + 1 = 0 
with^robts Xi = X2 = 1 • The complete solution is 

y, = A + Bk - 2k^ 

-^k ■ ' ^ 

For yo = 2 and Yi 7 3 

_ K = 2 3k - 2k2 



Self-Study ; Problem #A. 3 

Find ' solutions for the following second order difference eqtiations 

• . ^ ' -< ' ' ' 

; (a) y^^^ - ^^k+i Sy^ = ° ' ^ ' ^ 



■ (b) y^^2 - ^^k+i ^ ^^k = 6 r „ ^0 i ^ ' ^1 ° 

ERIC , ^ 
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(c) Ffcf a - ^y^fi ^yj, = ° ' 



(d) - 2yiH-i ^ 5yj^ ' ° - - = 0 ^ yr= 1 • 



yTc»-2 ^iH-i - 2yic = ; 



70 = 8 , 71 = -3 



1? 



ERIC 



Solution to Self -Study: Problem jiA> 3 

(a) Roots of characteristic equation are 2^ and 4 
From Case I of Section 2.2 

- '(b) ' Roots of characteristic equation are "2 and 4 
Prom Case I of Section 2.3 the- particular solution is 



From Case I of SectionT2.2 then 



y^ = 3-2^ -4+2 

(c) Roots of characteristic eq^uation are 1 ± 2i , 
From Case III of Section 2.2 then 

. y^ = A(y^) cos/ (k 6 + B) 

where 6 = cos^-^ (/5/5). From the initial conditions 

O = A ^ cos B 

, . 1 = A cos (e + B) " , • .. 

, . , - , ■ . . ■■. ' 

■ ■ ■ . SO . • ■ ' , 

/--.Jc-1 sin k 9 . 

(d) Rpots of the characteristic equation are 2 and 2 , so from 
Case II of Section 2.2 

■ ■ / . ' .■ . . ■ 

ERIC 



(e) Roots of the characteristic equation are .1 and 
The' particular solution is from Case II of Section .2.3 



From Case I of Section 2.2 tfeen 



' y- - 5X-2)^ + 3 + 4k 



(f) Roots of the characteristic eqttation are 1 .and 
The particular solution is from Case III of Section 2,3 



From Case II of Section 2.2 then 



y = 5 + 41c + 3k2 
k 
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APPENDIX 
authors; EVALUATION 
(Please circle one of the responses to each question) 



^1 Did you att<6nd- the short course in' 1974-75? 
2. Is this chapter 

Too short 

a. 

(b) Too long 

(c) About right 

If (a), which topics should be expanded? 



Yes. 



No' 



r 



can you suggest topics to l^e added? 



r If (b) , vhich topics should be abbreviated^ 



which topics .should be eliminated? 



3. Could you read and understand t 

(a) - always \ 

(b) sometimes 



iputer programs? 

(c) seldom 



vA^^'^id the interim projects seem reasonable? 

5. Were the self-study problems 

(a) Too easy 

6. .Was the numbeii of. self-study problems. 

(a) Too large 
. (b) About right 



ERLC 



(c.) Too small 



242 



(d) never 



Yes 



No 



(b) Too difficult 



■ ■ • 

7. Did you attempt any of the self-study problems? Yes 

* ' ■ * 
B. Are the solutions, to the self-stujiy problems 

properly placed (on overleaf from problem)? \. Yes 

^If no, where would you suggest the solutions be placed? 



No 



No 



9. For each topic, how solid an understanding do you think you have' 



\ 



Excellent Good' Taijc, Poor 



Definition of Difference 'Equa:tlons' 

Solutions of Tirst Order Equations 

Soliitions of Second Order Equations 

Analysis of Qualitative Behavior ' 
of Soluitons 




r 
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